Maturity taxonomy
Ce contenu n’est pas encore disponible dans votre langue.
Maturity taxonomy
Section titled “Maturity taxonomy”the model behind the scorecard
Surfaces > categories > capabilities > evidence.
50 surfaces grouped into 4 families, with every category tied back to canonical docs and QA coverage IDs.
How to read this page
Section titled “How to read this page”A surface is a product area such as Gateway runtime, Discord, or the macOS app. Each surface contains categories, and each category contains the capability-level checks that QA scenarios cover. Use the scorecard for release-level judgment; use this page to inspect the model underneath it.
Maturity levels
Section titled “Maturity levels”Product areas
Section titled “Product areas”CLI
Gateway runtime
Agent Runtime
Session, memory, and context engine
Channel framework
Observability
Gateway Web App
Plugins
Security, auth, pairing, and secrets
Automation: cron, hooks, tasks, polling
Media understanding and media generation
Voice and realtime talk
TUI
ClawHub
OpenClaw App SDK
Linux Gateway host
macOS Gateway host
Android app
iOS app
Docker and Podman hosting
Windows via WSL2
Raspberry Pi and small Linux devices
macOS companion app
Native Windows
Kubernetes hosting
Nix install path
watchOS companion surfaces
Linux companion app
Native Windows companion app
Details
Section titled “Details”CLI - M4 Stable - 7 areas
Normal setup and repair paths are documented across install, CLI, and gateway docs. Platform-specific Windows paths are tracked in the Windows via WSL2 and Native Windows rows.
Coverage Experimental - 4%
Quality Stable - 83%
Completeness Stable - 90%
Partial - 6
Area
Coverage
Quality
Completeness
Docs
Onboarding and Auth Setup
5 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Gateway Service Management
5 capabilities / LTS-supported
Experimental
14%
Stable
87%
Stable
90%
CLI Observability
5 capabilities / LTS-supported
Experimental
0%
Stable
89%
Stable
90%
Doctor
10 capabilities / LTS-supported
Experimental
0%
Stable
89%
Stable
90%
Updates and Upgrades
5 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Gateway runtime - M4 Stable - 13 areas
Core architecture, auth, pairing, protocol docs, daemon docs, and CLI runbooks are broad and current.
Coverage Experimental - 6%
Quality Stable - 81%
Completeness Stable - 89%
Partial - 12
Area
Coverage
Quality
Completeness
Docs
HTTP APIs
4 capabilities / LTS-supported
Experimental
25%
Stable
90%
Stable
90%
Hosted Web Surface
4 capabilities / LTS-supported
Experimental
0%
Stable
89%
Stable
90%
Gateway RPC APIs and Events
20 capabilities / LTS-supported
Experimental
9%
Stable
90%
Stable
90%
Device Auth and Pairing
10 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Network Access and Discovery
6 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Nodes and Remote Capabilities
8 capabilities
Experimental
0%
Beta
75%
Stable
89%
Health, Diagnostics, and Repair
7 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Protocol Compatibility
7 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Security Controls
6 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
WebSocket Connection
8 capabilities / LTS-supported
Experimental
13%
Stable
90%
Stable
90%
Agent Runtime - M3 Beta - 9 areas
Main loop, models, provider routing, and tool streaming are first-class, but provider behavior shifts weekly and needs scenario proof per release.
Coverage Experimental - 33%
Quality Beta - 78%
Completeness Beta - 79%
Partial - 6
Area
Coverage
Quality
Completeness
Docs
External Runtimes and Subagents
4 capabilities
Experimental
30%
Beta
79%
Beta
79%
Hosted Provider Execution
5 capabilities / LTS-supported
Experimental
20%
Beta
79%
Beta
79%
Model and Runtime Selection
4 capabilities / LTS-supported
Experimental
25%
Beta
79%
Beta
79%
Provider Auth
10 capabilities / LTS-supported
Experimental
24%
Beta
79%
Beta
79%
Tool Calls and Response Handling
3 capabilities / LTS-supported
Alpha
65%
Beta
79%
Beta
79%
Tool Execution Controls
6 capabilities / LTS-supported
Alpha
50%
Beta
79%
Beta
79%
Session, memory, and context engine - M3 Beta - 9 areas
Strong docs and active implementation. Maturity depends on transcript durability, compaction quality, and cross-client parity.
Coverage Experimental - 30%
Quality Beta - 77%
Completeness Beta - 79%
Partial - 6
Area
Coverage
Quality
Completeness
Docs
Token Management
3 capabilities / LTS-supported
Experimental
20%
Beta
79%
Beta
79%
Context Engine
2 capabilities / LTS-supported
Alpha
57%
Beta
79%
Beta
79%
Cross-client History and Session Parity
2 capabilities
Experimental
40%
Beta
79%
Beta
79%
Diagnostics, Maintenance, and Recovery
3 capabilities
Experimental
40%
Beta
79%
Beta
79%
Core Prompts and Context
2 capabilities / LTS-supported
Experimental
38%
Beta
79%
Beta
79%
Session Routing
2 capabilities / LTS-supported
Experimental
25%
Beta
79%
Beta
79%
Transcript Persistence
2 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Channel framework - M3 Beta - 8 areas
Many channels share Gateway delivery and routing contracts, but channel behavior varies by upstream API and account-policy constraints.
Coverage Experimental - 13%
Quality Beta - 76%
Completeness Beta - 79%
Partial - 5
Area
Coverage
Quality
Completeness
Docs
Channel Setup
5 capabilities / LTS-supported
Experimental
14%
Beta
79%
Beta
79%
Group Thread and Ambient Room Behavior
5 capabilities
Experimental
36%
Beta
79%
Beta
79%
Inbound Access and Identity Gates
5 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Media Attachments and Rich Channel Data
4 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Outbound Delivery and Reply Pipeline
4 capabilities / LTS-supported
Experimental
38%
Beta
79%
Beta
79%
Conversation Routing and Delivery
10 capabilities / LTS-supported
Experimental
19%
Beta
79%
Beta
79%
Status Health and Operator Controls
4 capabilities / LTS-supported
Experimental
0%
Beta
79%
Beta
79%
Observability - M3 Beta - 5 areas
OTel, Prometheus, logging, and diagnostics docs exist. Needs a public “what operators should look at first” maturity pass.
Coverage Experimental - 18%
Quality Beta - 75%
Completeness Beta - 79%
Partial - 3
Area
Coverage
Quality
Completeness
Docs
Diagnostic Collection
8 capabilities
Experimental
30%
Beta
79%
Beta
79%
Telemetry Export
13 capabilities
Experimental
33%
Beta
79%
Beta
79%
Session Diagnostics
4 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Gateway Web App - M3 Beta - 6 areas
Web UI is documented with pairing, chat, PWA, Talk, push, and remote Gateway flows. Promote after cross-browser and mobile-PWA scorecards.
Coverage Experimental - 4%
Quality Beta - 74%
Completeness Beta - 79%
None
Area
Coverage
Quality
Completeness
Docs
Browser Access and Trust
5 capabilities
Experimental
0%
Alpha
68%
Beta
79%
WebChat Conversations
15 capabilities
Experimental
10%
Beta
79%
Beta
79%
Plugins - M3 Beta - 9 areas
Broad docs and strong internal runtime evidence exist across manifests, discovery, loading, provider/tool architecture, and approval boundaries. Keep the row at beta until public SDK API/subpaths and external distribution proof are stronger.
Coverage Experimental - 12%
Quality Beta - 72%
Completeness Beta - 79%
Partial - 7
Area
Coverage
Quality
Completeness
Docs
Bundled plugins
5 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Installing and running plugins
6 capabilities / LTS-supported
Experimental
35%
Beta
79%
Beta
79%
Channel plugins
5 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Provider and tool plugins
6 capabilities / LTS-supported
Experimental
43%
Beta
79%
Beta
79%
Plugin approvals
6 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Publishing plugins
6 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Security, auth, pairing, and secrets - M3 Beta - 6 areas
Good docs and hardening surfaces exist. Promote after regular upgrade/security scenario runs prove no setup regressions.
Coverage Experimental - 16%
Quality Beta - 72%
Completeness Beta - 79%
Partial - 5
Area
Coverage
Quality
Completeness
Docs
Gateway Auth and Remote Access
9 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Channel Access Control
3 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Device and Node Pairing
11 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
Plugin Trust
2 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Credential and Secret Hygiene
5 capabilities / LTS-supported
Experimental
46%
Beta
79%
Beta
79%
Automation: cron, hooks, tasks, polling - M3 Beta - 6 areas
Documented and usable, but scenario proof should cover unattended delivery, retries, and failure visibility.
Coverage Experimental - 2%
Quality Beta - 72%
Completeness Beta - 79%
None
Area
Coverage
Quality
Completeness
Docs
Event Ingress
15 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Automation Hooks
11 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Background Tasks and Flows
10 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Polling Controls
10 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Media understanding and media generation - M2 Alpha - 6 areas
Broad capability surface exists, but provider variance, file limits, and node/app parity make this not stable yet.
Coverage Experimental - 2%
Quality Alpha - 64%
Completeness Alpha - 68%
None
Area
Coverage
Quality
Completeness
Docs
Media Configuration
1 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Media Understanding
12 capabilities
Experimental
7%
Alpha
69%
Alpha
69%
Media Generation
17 capabilities
Experimental
5%
Alpha
69%
Alpha
69%
Voice and realtime talk - M2 Alpha - 6 areas
Multiple implementations exist across Control UI, apps, and providers. Needs latency, failure-mode, and setup scorecards before beta.
Coverage Experimental - 0%
Quality Alpha - 61%
Completeness Alpha - 68%
None
Area
Coverage
Quality
Completeness
Docs
Voice Wake and Routing
4 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
TUI - M2 Alpha - 5 areas
Present in docs and source, but less visible as a primary user workflow. Needs explicit scenario definition.
Coverage Experimental - 0%
Quality Alpha - 59%
Completeness Alpha - 66%
None
ClawHub - M2 Alpha - 4 areas
Public docs and ecosystem concept exist. Needs install, trust, update, rollback, and compatibility scorecards.
Coverage Experimental - 0%
Quality Alpha - 58%
Completeness Alpha - 62%
None
Area
Coverage
Quality
Completeness
Docs
Catalog Discovery
5 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Compatibility and Trust
12 capabilities
Experimental
0%
Alpha
55%
Alpha
56%
OpenClaw App SDK - M2 Alpha - 6 areas
OpenClaw App SDK is a distinct external app contract separate from Gateway runtime and Plugin SDK. Current scoring shows a real @openclaw/sdk path with gaps around public packaging, auto-discovery, approvals, helpers, and compatibility.
Coverage Experimental - 3%
Quality Alpha - 54%
Completeness Alpha - 53%
None
Area
Coverage
Quality
Completeness
Docs
Gateway Access
5 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
Agent Conversations
6 capabilities
Experimental
0%
Alpha
52%
Alpha
52%
Events and Approvals
5 capabilities
Experimental
0%
Alpha
52%
Alpha
52%
Platform
Section titled “Platform”Linux Gateway host - M4 Stable - 5 areas
Node runtime is recommended, systemd user service is documented, and VPS/container guidance is broad.
Coverage Experimental - 0%
Quality Beta - 75%
Completeness Stable - 89%
Partial - 4
Area
Coverage
Quality
Completeness
Docs
Gateway Runtime and Service Control
6 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Remote Access and Security
6 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Diagnostics and Repair
4 capabilities / LTS-supported
Experimental
0%
Beta
75%
Stable
89%
Status, Logs, Doctor, Diagnostics, Index
Deployment Targets
3 capabilities
Experimental
0%
Beta
75%
Stable
89%
macOS Gateway host - M4 Stable - 7 areas
LaunchAgent service path, local/remote Gateway modes, CLI install, and app integration are documented.
Coverage Experimental - 0%
Quality Beta - 74%
Completeness Stable - 88%
None
Area
Coverage
Quality
Completeness
Docs
Local Gateway Integration
9 capabilities
Experimental
0%
Beta
74%
Stable
88%
Gateway Service Lifecycle
10 capabilities
Experimental
0%
Beta
74%
Stable
88%
Diagnostics and Observability
4 capabilities
Experimental
0%
Beta
74%
Stable
88%
Android app - M4 Stable - 7 areas
Official Google Play distribution exists, source build/run docs are maintained, and the Android app is documented as a normal companion node for users.
Coverage Experimental - 0%
Quality Stable - 80%
Completeness Stable - 80%
None
iOS app - M4 Stable - 8 areas
Official App Store distribution exists, relay-backed push is documented, and the iOS app is documented as a normal companion node for users.
Coverage Experimental - 0%
Quality Stable - 80%
Completeness Stable - 80%
None
Docker and Podman hosting - M3 Beta - 4 areas
Install docs exist and are common deployment paths. Promote after recurring release smoke captures upgrade and volume behavior.
Coverage Experimental - 7%
Quality Beta - 71%
Completeness Beta - 79%
None
Area
Coverage
Quality
Completeness
Docs
Container Operations
11 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Image Release and Validation
5 capabilities
Experimental
29%
Beta
79%
Beta
79%
Windows via WSL2 - M3 Beta - 6 areas
Recommended Windows path with systemd/user-service guidance and boot-chain docs. Promote after repeated install/update scorecards.
Coverage Experimental - 6%
Quality Alpha - 69%
Completeness Beta - 79%
Partial - 5
Area
Coverage
Quality
Completeness
Docs
CLI
8 capabilities / LTS-supported
Experimental
0%
Alpha
67%
Beta
79%
Gateway Service Lifecycle
10 capabilities / LTS-supported
Experimental
0%
Alpha
67%
Beta
79%
Gateway Access and Exposure
11 capabilities / LTS-supported
Experimental
0%
Alpha
67%
Beta
79%
Diagnostics and Repair
6 capabilities / LTS-supported
Experimental
38%
Beta
79%
Beta
79%
Browser and Control UI
6 capabilities
Experimental
0%
Alpha
67%
Beta
79%
Raspberry Pi and small Linux devices - M3 Beta - 4 areas
Platform docs exist and Gateway path is Linux-based. Needs hardware-specific release smoke proof to move higher.
Coverage Experimental - 0%
Quality Alpha - 67%
Completeness Beta - 79%
None
Area
Coverage
Quality
Completeness
Docs
Remote Access and Auth
9 capabilities
Experimental
0%
Alpha
67%
Beta
79%
Performance and Diagnostics
5 capabilities
Experimental
0%
Alpha
67%
Beta
79%
macOS companion app - M3 Beta - 8 areas
Rich menu bar app, permissions, node mode, Canvas, voice wake, WebChat, and remote mode exist. Still fast-moving enough to avoid Stable.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Local Setup
7 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Status and Settings
5 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Native Capabilities
5 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Native Windows - M2 Alpha - 4 areas
Core CLI/Gateway flows work, but docs still recommend WSL2 for the full experience and list native caveats.
Coverage Experimental - 0%
Quality Alpha - 58%
Completeness Alpha - 66%
Partial - 1
Kubernetes hosting - M2 Alpha - 4 areas
Kubernetes hosting is a distinct Kustomize-based cluster deployment path. Current scoring shows a real minimal deployment path with gaps around Kubernetes-specific CI, ingress/TLS/NetworkPolicy packaging, backup/restore, and production exposure hardening.
Coverage Experimental - 0%
Quality Alpha - 55%
Completeness Alpha - 61%
None
Area
Coverage
Quality
Completeness
Docs
Configuration and Secrets
5 capabilities
Experimental
0%
Alpha
55%
Alpha
61%
Access and Exposure
5 capabilities
Experimental
0%
Alpha
55%
Alpha
61%
Nix install path - M1 Experimental - 5 areas
Optional install flow. Needs clearer support promise before alpha/beta promotion.
Coverage Experimental - 0%
Quality Experimental - 41%
Completeness Experimental - 44%
None
Area
Coverage
Quality
Completeness
Docs
Plugin Lifecycle
4 capabilities
Experimental
0%
Experimental
41%
Experimental
44%
watchOS companion surfaces - M1 Experimental - 5 areas
Source has Watch app/extension surfaces; public docs do not yet present this as a user feature.
Coverage Experimental - 0%
Quality Experimental - 41%
Completeness Experimental - 44%
None
Linux companion app - M0 Planned - 5 areas
Docs say native Linux companion apps are planned; Gateway is the supported Linux path today.
Coverage Experimental - 0%
Quality Experimental - 19%
Completeness Experimental - 21%
None
Area
Coverage
Quality
Completeness
Docs
Gateway Connectivity
4 capabilities
Experimental
0%
Experimental
19%
Experimental
21%
Desktop Capabilities
9 capabilities
Experimental
0%
Experimental
19%
Experimental
21%
Native Windows companion app - M0 Planned - 5 areas
Planned only.
Coverage Experimental - 0%
Quality Experimental - 19%
Completeness Experimental - 21%
None
Area
Coverage
Quality
Completeness
Docs
Gateway Connection
3 capabilities
Experimental
0%
Experimental
19%
Experimental
21%
Desktop Tools and Permissions
10 capabilities
Experimental
0%
Experimental
19%
Experimental
21%
Channel
Section titled “Channel”Discord - M4 Stable - 6 areas
Deep docs and broad feature coverage. Voice/delegation paths should stay separately scored as beta/alpha.
Coverage Experimental - 0%
Quality Beta - 73%
Completeness Stable - 87%
Partial - 4
Area
Coverage
Quality
Completeness
Docs
Access and Identity
6 capabilities / LTS-supported
Experimental
0%
Beta
73%
Stable
87%
Conversation Routing and Delivery
12 capabilities / LTS-supported
Experimental
0%
Beta
73%
Stable
87%
Realtime Voice and Calls
5 capabilities
Experimental
0%
Beta
73%
Stable
87%
Telegram - M3 Beta - 5 areas
Core channel is mature enough for regular use, but high-variance UX and media edge cases need recurring scenario proof.
Coverage Experimental - 0%
Quality Alpha - 68%
Completeness Beta - 78%
Full - 5
Area
Coverage
Quality
Completeness
Docs
Access and Identity
10 capabilities / LTS-supported
Experimental
0%
Alpha
66%
Beta
78%
Conversation Routing and Delivery
1 capabilities / LTS-supported
Experimental
0%
Alpha
66%
Beta
78%
Native Controls and Approvals
9 capabilities / LTS-supported
Experimental
0%
Beta
77%
Beta
79%
Slack - M3 Beta - 5 areas
First-class channel docs and routing surface. Needs workspace install/admin scenario scorecards.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
Full - 5
Area
Coverage
Quality
Completeness
Docs
Conversation Routing and Delivery
5 capabilities / LTS-supported
Experimental
0%
Alpha
66%
Beta
78%
Media and Rich Content
1 capabilities / LTS-supported
Experimental
0%
Alpha
66%
Beta
78%
Native Controls and Approvals
8 capabilities / LTS-supported
Experimental
0%
Alpha
66%
Beta
78%
iMessage and BlueBubbles - M3 Beta - 5 areas
Supported iMessage runs through imsg on a signed-in macOS Messages host; legacy BlueBubbles configs require migration. Keep macOS permissions, SSH wrapper, SIP/private API, and migration caveats visible.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Access and Identity
6 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Media and Rich Content
7 capabilities
Experimental
0%
Alpha
66%
Beta
78%
WhatsApp - M3 Beta - 5 areas
Core path is important and documented; upstream Baileys/session volatility keeps it below Stable.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Access and Identity
7 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Conversation Routing and Delivery
4 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Matrix - M2 Alpha - 6 areas
Supported via bundled plugin. Needs bridge, auth, and room lifecycle scorecards.
Coverage Experimental - 0%
Quality Alpha - 60%
Completeness Alpha - 67%
None
Google Chat - M2 Alpha - 5 areas
Documented channel, but enterprise/admin setup raises maturity risk.
Coverage Experimental - 0%
Quality Alpha - 59%
Completeness Alpha - 66%
None
Area
Coverage
Quality
Completeness
Docs
Access and Identity
11 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Conversation Routing and Delivery
1 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Media and Rich Content
1 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Native Controls and Approvals
16 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Microsoft Teams - M2 Alpha - 5 areas
Enterprise auth/admin flows need explicit scenario proof.
Coverage Experimental - 0%
Quality Alpha - 59%
Completeness Alpha - 66%
None
Area
Coverage
Quality
Completeness
Docs
Conversation Routing and Delivery
5 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Native Controls and Approvals
5 capabilities
Experimental
0%
Alpha
59%
Alpha
66%
Signal - M2 Alpha - 5 areas
Supported channel docs exist; needs stronger install and reconnect proof.
Coverage Experimental - 0%
Quality Alpha - 59%
Completeness Alpha - 66%
None
Feishu, QQ Bot, WeChat, Yuanbao, Zalo, Zalo Personal, regional channels - M2 Alpha - 4 areas
Important regional coverage, but public support level should be calibrated per account type, upstream approval, and maintainer proof.
Coverage Experimental - 0%
Quality Alpha - 55%
Completeness Alpha - 58%
None
Area
Coverage
Quality
Completeness
Docs
Access and Identity
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Conversation Routing and Delivery
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Media and Rich Content
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Mattermost, LINE, IRC, Nextcloud Talk, Nostr, Twitch, Tlon, Synology Chat - M2 Alpha - 4 areas
Supported surfaces exist, but maturity likely varies by upstream and maintainer coverage. Score individually later.
Coverage Experimental - 0%
Quality Alpha - 53%
Completeness Alpha - 54%
None
Area
Coverage
Quality
Completeness
Docs
Channel Setup and Operations
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Access and Identity
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Conversation Routing and Delivery
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Media and Rich Content
1 capabilities
Experimental
0%
Alpha
53%
Alpha
54%
No linked docs
Voice Call channel - M1 Experimental - 5 areas
Optional/plugin path with complex realtime behavior. Needs scenario scorecard before public beta.
Coverage Experimental - 0%
Quality Experimental - 41%
Completeness Experimental - 44%
None
Area
Coverage
Quality
Completeness
Docs
Conversation Routing and Delivery
1 capabilities
Experimental
0%
Experimental
41%
Experimental
44%
Media and Rich Content
2 capabilities
Experimental
0%
Experimental
41%
Experimental
44%
Provider and tool
Section titled “Provider and tool”Browser automation, exec, and sandbox tools - M3 Beta - 3 areas
Core tools are documented, but host security and permission UX should stay under active scorecard review.
Coverage Experimental - 21%
Quality Beta - 75%
Completeness Beta - 79%
Partial - 2
Area
Coverage
Quality
Completeness
Docs
Tool Invocation and Execution
6 capabilities / LTS-supported
Alpha
50%
Beta
79%
Beta
79%
Sandbox and Tool Policy
6 capabilities / LTS-supported
Experimental
0%
Alpha
68%
Beta
79%
OpenAI and Codex provider path - M3 Beta - 5 areas
Deep docs, OAuth/subscription path, realtime voice, image, and compatibility behavior. Provider churn keeps this from Stable without release-scorecard proof.
Coverage Experimental - 26%
Quality Beta - 74%
Completeness Beta - 79%
Partial - 3
Area
Coverage
Quality
Completeness
Docs
Responses and Tool Compatibility
4 capabilities / LTS-supported
Experimental
40%
Beta
79%
Beta
79%
Native Codex Harness
2 capabilities / LTS-supported
Experimental
44%
Beta
79%
Beta
79%
Image and Multimodal Input
2 capabilities
Experimental
0%
Alpha
67%
Beta
79%
Web search tools - M3 Beta - 4 areas
Multiple providers and docs exist. Needs quota/error/SSRF proof per provider family.
Coverage Experimental - 9%
Quality Beta - 74%
Completeness Beta - 79%
None
Area
Coverage
Quality
Completeness
Docs
Setup and Diagnostics
9 capabilities
Experimental
0%
Alpha
68%
Beta
79%
Tool Availability and Fetch
11 capabilities
Experimental
25%
Beta
79%
Beta
79%
Anthropic provider path - M3 Beta - 5 areas
First-class model provider. Needs recurring auth/catalog/tool-call scenario proof.
Coverage Experimental - 0%
Quality Beta - 71%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Model and Runtime Selection
10 capabilities
Experimental
0%
Beta
78%
Beta
79%
Request Transport and Turn Semantics
10 capabilities
Experimental
0%
Beta
77%
Beta
79%
Prompt Cache and Context
5 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Google provider path - M3 Beta - 5 areas
First-class provider with model and realtime surfaces. Needs separate Live/Talk scoring.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Model Routing and Endpoints
10 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Direct Gemini Runtime
9 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Prompt Caching
5 capabilities
Experimental
0%
Alpha
66%
Beta
78%
OpenRouter provider path - M3 Beta - 4 areas
Unified provider path is documented and valuable, but model-specific behavior varies.
Coverage Experimental - 0%
Quality Alpha - 66%
Completeness Beta - 78%
None
Area
Coverage
Quality
Completeness
Docs
Chat Runtime and Normalization
15 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Provider Recovery and Diagnostics
5 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Media Generation and Speech
7 capabilities
Experimental
0%
Alpha
66%
Beta
78%
Image, video, and music generation tools - M2 Alpha - 5 areas
Capability exists across providers, but quality, latency, and parameter compatibility vary too much for beta without per-provider proof.
Coverage Experimental - 0%
Quality Alpha - 61%
Completeness Alpha - 68%
None
Area
Coverage
Quality
Completeness
Docs
Task Lifecycle and Delivery
12 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Video Generation
11 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Local model providers: Ollama, vLLM, SGLang, LM Studio - M2 Alpha - 5 areas
Useful and documented, but environment variance is high.
Coverage Experimental - 0%
Quality Alpha - 61%
Completeness Alpha - 68%
None
Area
Coverage
Quality
Completeness
Docs
OpenAI-Compatible Runtime Compatibility
8 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Network Safety and Prompt Controls
2 capabilities
Experimental
0%
Alpha
61%
Alpha
68%
Long-tail hosted providers - M2 Alpha - 3 areas
Many docs/reference pages exist; score should be generated from provider metadata plus live smoke coverage.
Coverage Experimental - 0%
Quality Alpha - 61%
Completeness Alpha - 68%
None
Area
Coverage
Quality
Completeness
Docs
Provider Operations
12 capabilities
Experimental
0%
Alpha
61%
Alpha
68%