Generated 2026-04-12 23:22 UTC • Target: https://agentbin.greensmoke-1163cb63.eastus.azurecontainerapps.io
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/subscribe-to-task | SubscribeToTask | The operation was canceled. | Known: SubscribeToTask returns 'Task is in a terminal state' — server-side issue with resubscription to completed tasks. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/subscribe-to-task | SubscribeToTask | The operation was canceled. | — |
rest/error-subscribe-not-found | Subscribe Not Found | expected error, got events | Known: REST subscribe returns events instead of NotFound error. Server-side issue with REST SSE error handling for non-existent tasks. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
v03/spec03-agent-card | v0.3 Agent Card | Failed to parse JSON: JSON deserialization for type 'A2A.AgentCard' was missing required properties including: 'supportedInterfaces'. | Known: .NET SDK rejects v0.3 agent card — missing 'supportedInterfaces'. V1.0 SDK cannot parse v0.3 agent cards that lack supportedInterfaces field. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/agent-card-spec | Spec Agent Card | error: card parsing failed: json: cannot unmarshal object into Go struct field AgentCard.securityRequirements.schemes of type a2a.SecuritySchemeScopes | — |
jsonrpc/spec-message-only | Message Only | skipped — no spec client | — |
jsonrpc/spec-task-lifecycle | Task Lifecycle | skipped — no spec client | — |
jsonrpc/spec-get-task | GetTask | skipped — no spec client | — |
jsonrpc/spec-task-failure | Task Failure | skipped — no spec client | — |
jsonrpc/spec-data-types | Data Types | skipped — no spec client | — |
jsonrpc/spec-streaming | Streaming | skipped — no spec client | — |
jsonrpc/error-task-not-found | Task Not Found Error | skipped — no spec client | — |
jsonrpc/spec-multi-turn | Multi-Turn | skipped — no spec client | — |
jsonrpc/spec-task-cancel | Task Cancel (via streaming) | skipped — no spec client | — |
jsonrpc/spec-cancel-with-metadata | Cancel With Metadata | skipped — no spec client | — |
jsonrpc/spec-list-tasks | ListTasks | skipped — no spec client | — |
jsonrpc/spec-return-immediately | Return Immediately | skipped — no spec client | Known: .NET A2A server does not implement returnImmediately. The SDK blocks until the task completes instead of returning early. |
jsonrpc/error-cancel-not-found | Cancel Not Found | skipped — no spec client | — |
jsonrpc/error-cancel-terminal | Cancel Terminal Task | skipped — no spec client | — |
jsonrpc/error-send-terminal | Send To Terminal Task | skipped — no spec client | — |
jsonrpc/error-send-invalid-task | Send Invalid TaskId | skipped — no spec client | — |
jsonrpc/error-push-not-supported | Push Not Supported | skipped — no spec client | — |
jsonrpc/subscribe-to-task | SubscribeToTask | skipped — no spec client | — |
jsonrpc/error-subscribe-not-found | Subscribe Not Found | skipped — no spec client | — |
jsonrpc/stream-message-only | Stream Message Only | skipped — no spec client | — |
jsonrpc/stream-task-lifecycle | Stream Task Lifecycle | skipped — no spec client | — |
jsonrpc/multi-turn-context-preserved | Context Preserved | skipped — no spec client | — |
jsonrpc/get-task-with-history | GetTask With History | skipped — no spec client | — |
jsonrpc/get-task-after-failure | GetTask After Failure | skipped — no spec client | — |
jsonrpc/spec-extended-card | Extended Agent Card | skipped — no spec card | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/agent-card-spec | Spec Agent Card | error: card parsing failed: json: cannot unmarshal object into Go struct field AgentCard.securityRequirements.schemes of type a2a.SecuritySchemeScopes | — |
rest/spec-message-only | Message Only | skipped — no REST spec client | — |
rest/spec-task-lifecycle | Task Lifecycle | skipped — no REST spec client | — |
rest/spec-get-task | GetTask | skipped — no REST spec client | — |
rest/spec-task-failure | Task Failure | skipped — no REST spec client | — |
rest/spec-data-types | Data Types | skipped — no REST spec client | — |
rest/spec-streaming | Streaming | skipped — no REST spec client | — |
rest/error-task-not-found | Task Not Found Error | skipped — no REST spec client | — |
rest/spec-multi-turn | Multi-Turn | skipped — no REST spec client | — |
rest/spec-task-cancel | Task Cancel (via streaming) | skipped — no REST spec client | — |
rest/spec-cancel-with-metadata | Cancel With Metadata | skipped — no REST spec client | Known: REST cancel succeeds but metadata is nil in response. Server does not echo cancel metadata back via REST binding. |
rest/spec-list-tasks | ListTasks | skipped — no REST spec client | — |
rest/spec-return-immediately | Return Immediately | skipped — no REST spec client | Known: .NET A2A server does not implement returnImmediately. The SDK blocks until the task completes instead of returning early. |
rest/error-cancel-not-found | Cancel Not Found | skipped — no REST spec client | — |
rest/error-cancel-terminal | Cancel Terminal Task | skipped — no REST spec client | — |
rest/error-send-terminal | Send To Terminal Task | skipped — no REST spec client | — |
rest/error-send-invalid-task | Send Invalid TaskId | skipped — no REST spec client | — |
rest/error-push-not-supported | Push Not Supported | skipped — no REST spec client | — |
rest/subscribe-to-task | SubscribeToTask | skipped — no REST spec client | Known: REST SubscribeToTask returns server error. Server-side issue with REST SSE resubscription. |
rest/error-subscribe-not-found | Subscribe Not Found | skipped — no REST spec client | — |
rest/stream-message-only | Stream Message Only | skipped — no REST spec client | — |
rest/stream-task-lifecycle | Stream Task Lifecycle | skipped — no REST spec client | — |
rest/multi-turn-context-preserved | Context Preserved | skipped — no REST spec client | — |
rest/get-task-with-history | GetTask With History | skipped — no REST spec client | — |
rest/get-task-after-failure | GetTask After Failure | skipped — no REST spec client | — |
rest/spec-extended-card | Extended Agent Card | skipped — no REST spec card | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
v03/spec03-agent-card | v0.3 Agent Card | protocolVersion=, hasUrl=false | — |
v03/spec03-send-message | v0.3 Send Message | client create error (SDK may not support v0.3): agent card has no supported interfaces | Known: Go SDK rejects v0.3 agent card — 'no supported interfaces'. V1.0 SDK does not fall back to v0.3 protocol. |
v03/spec03-task-lifecycle | v0.3 Task Lifecycle | client create error (SDK may not support v0.3): agent card has no supported interfaces | Known: Go SDK rejects v0.3 agent card. Same root cause as spec03-send-message. |
v03/spec03-streaming | v0.3 Streaming | client create error (SDK may not support v0.3): agent card has no supported interfaces | Known: Go SDK rejects v0.3 agent card. Same root cause as spec03-send-message. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/spec-cancel-with-metadata | Cancel With Metadata | taskId=0f93a70ba014489e9c8419714bfa6710, canceled=True, metadataOk=False, keys=[] | Known: Python SDK REST cancel succeeds but metadata keys are empty. REST binding does not echo cancel metadata back in response. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
v03/spec03-send-message | v0.3 Send Message | SDK v0.3 send failed: MethodNotFoundError: Invalid JSON-RPC request: 'method' field is not a valid A2A method. | Known: Python SDK sends v1.0 method names (message/send) to v0.3 agent which only accepts v0.3 method names (tasks/send). SDK does not fall back. |
v03/spec03-task-lifecycle | v0.3 Task Lifecycle | SDK v0.3 send failed: MethodNotFoundError: Invalid JSON-RPC request: 'method' field is not a valid A2A method. | Known: Python SDK sends v1.0 method names to v0.3 agent. Same root cause as spec03-send-message. |
v03/spec03-streaming | v0.3 Streaming | SDK v0.3 stream failed: MethodNotFoundError: Invalid JSON-RPC request: 'method' field is not a valid A2A method. | Known: Python SDK sends v1.0 method names to v0.3 agent. Same root cause as spec03-send-message. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/echo-send-message | Echo Send Message | text=AgentBin Spec Agent — A2A v1.0 Test Bed Send a message starting with one of these skill keywords: message-only → Stateless message response (no task) task-lifecycle → Full task: submitted → working → completed task-failure → Task that fails with error message task-cancel → Task that waits to be canceled multi-turn → Multi-turn conversation (input-required) streaming → Streamed response with multiple chunks long-running → Long-running task with periodic updates data-types → Mixed content: text, JSON, file, multi-part Example: 'task-lifecycle hello world' | — |
jsonrpc/spec-task-lifecycle | Task Lifecycle | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 protobuf conversion produces null task 'id'. Client-side: SDK's Task constructor rejects null 'id' during response deserialization. |
jsonrpc/spec-get-task | GetTask | skipped | Known: Skipped because task-lifecycle fails (no task ID to query). |
jsonrpc/spec-task-failure | Task Failure | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-data-types | Data Types | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-streaming | Streaming | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-multi-turn | Multi-Turn | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-task-cancel | Task Cancel (via streaming) | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-cancel-with-metadata | Cancel With Metadata | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/spec-list-tasks | ListTasks | count=0 | Known: Java SDK JSONRPC listTasks returns 0 results — likely protobuf deserialization issue with task list response. |
jsonrpc/spec-return-immediately | Return Immediately | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/error-cancel-terminal | Cancel Terminal Task | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/error-send-terminal | Send To Terminal Task | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/error-send-invalid-task | Send Invalid TaskId | expected error, got success | Known: Java SDK Beta1 — expected error but got success. Client-side null-ID bug causes SDK to send wrong task ID. |
jsonrpc/subscribe-to-task | SubscribeToTask | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/error-subscribe-not-found | Subscribe Not Found | expected error, got success | Known: Java SDK Beta1 — expected error but got success. Client-side null-ID bug causes SDK to send wrong task ID. |
jsonrpc/stream-task-lifecycle | Stream Task Lifecycle | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/multi-turn-context-preserved | Context Preserved | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/get-task-with-history | GetTask With History | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
jsonrpc/get-task-after-failure | GetTask After Failure | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug. Same root cause as spec-task-lifecycle. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/echo-send-message | Echo Send Message | text=AgentBin Spec Agent — A2A v1.0 Test Bed Send a message starting with one of these skill keywords: message-only → Stateless message response (no task) task-lifecycle → Full task: submitted → working → completed task-failure → Task that fails with error message task-cancel → Task that waits to be canceled multi-turn → Multi-turn conversation (input-required) streaming → Streamed response with multiple chunks long-running → Long-running task with periodic updates data-types → Mixed content: text, JSON, file, multi-part Example: 'task-lifecycle hello world' | — |
rest/spec-cancel-with-metadata | Cancel With Metadata | taskId=97ad4c0257b5483fad57f6c253f84c76, state=CANCELED, metadata not echoed (reason/requestedBy not in response) | Known: REST cancel succeeds but cancel metadata (reason/requestedBy) not echoed in response. Server-side limitation. |
rest/spec-list-tasks | ListTasks | InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK REST listTasks fails — client-side null 'id' bug during response deserialization. |
rest/error-send-terminal | Send To Terminal Task | expected error, got success | Known: Java SDK Beta1 — expected error but got success. REST binding may not properly propagate terminal-state errors. |
rest/error-send-invalid-task | Send Invalid TaskId | expected error, got success | Known: Java SDK Beta1 — expected error but got success. REST binding may not properly propagate task-not-found errors. |
rest/error-subscribe-not-found | Subscribe Not Found | expected error, got success | Known: Java SDK Beta1 — expected error but got success. REST binding may not properly propagate subscription errors. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
v03/spec03-agent-card | v0.3 Agent Card | protocolVersion=0.3.0=false, hasUrl=true | — |
v03/spec03-task-lifecycle | v0.3 Task Lifecycle | SDK may not support v0.3 fallback: InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug affects v0.3 tests. Same root cause as JSONRPC null-ID issue. |
v03/spec03-streaming | v0.3 Streaming | SDK may not support v0.3 fallback: InvalidParamsError: Parameter 'id' may not be null | Known: Java SDK Beta1 client-side null 'id' bug affects v0.3 tests. Same root cause as JSONRPC null-ID issue. |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/agent-card-echo | Echo Agent Card | name=AgentBin Spec Agent, skills=8 | — |
jsonrpc/echo-send-message | Echo Send Message | JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | — |
jsonrpc/spec-message-only | Message Only | JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | — |
jsonrpc/spec-task-lifecycle | Task Lifecycle | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-get-task | GetTask | skipped — no taskId from lifecycle | — |
jsonrpc/spec-task-failure | Task Failure | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-data-types | Data Types | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-streaming | Streaming | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-multi-turn | Multi-Turn | JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | — |
jsonrpc/spec-task-cancel | Task Cancel (via streaming) | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-cancel-with-metadata | Cancel With Metadata | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/spec-list-tasks | ListTasks | SDK not supported: JS SDK does not expose listTasks | Known: JS SDK does not expose listTasks method. |
jsonrpc/spec-return-immediately | Return Immediately | JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | Known: .NET A2A server does not implement returnImmediately. The SDK blocks until the task completes instead of returning early. |
jsonrpc/error-cancel-terminal | Cancel Terminal Task | error=Error: Invalid response Content-Type for SSE stream for message/stream. Expected 'text/ | — |
jsonrpc/subscribe-to-task | SubscribeToTask | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/error-subscribe-not-found | Subscribe Not Found | error=Error: Invalid response Content-Type for SSE stream for tasks/resubscribe. Expected 'te | Known: Server returns 'internal error during streaming' instead of NotFound error. Server-side issue with subscription error handling. |
jsonrpc/stream-message-only | Stream Message Only | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/stream-task-lifecycle | Stream Task Lifecycle | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
jsonrpc/multi-turn-context-preserved | Context Preserved | JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | — |
jsonrpc/get-task-with-history | GetTask With History | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | Known: Server returns task with 0 history items. Server may not persist message history for getTask requests. |
jsonrpc/get-task-after-failure | GetTask After Failure | Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/agent-card-echo | Echo Agent Card | name=AgentBin Spec Agent, skills=8 | — |
rest/echo-send-message | Echo Send Message | HTTP error for /v1/message:send! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-message-only | Message Only | HTTP error for /v1/message:send! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-task-lifecycle | Task Lifecycle | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-get-task | GetTask | skipped — no taskId from lifecycle | — |
rest/spec-task-failure | Task Failure | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-data-types | Data Types | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-streaming | Streaming | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-multi-turn | Multi-Turn | HTTP error for /v1/message:send! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-task-cancel | Task Cancel (via streaming) | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/spec-cancel-with-metadata | Cancel With Metadata | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | Known: REST cancel succeeds but metadata keys are empty. REST binding does not echo cancel metadata back in response. |
rest/spec-list-tasks | ListTasks | SDK not supported: JS SDK does not expose listTasks | Known: JS SDK does not expose listTasks method. |
rest/spec-return-immediately | Return Immediately | HTTP error for /v1/message:send! Status: 404 Not Found. Response: 404 page not found | Known: .NET A2A server does not implement returnImmediately. The SDK blocks until the task completes instead of returning early. |
rest/error-cancel-terminal | Cancel Terminal Task | error=Error: HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not | — |
rest/subscribe-to-task | SubscribeToTask | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | Known: REST subscribe returns 0 events. Server-side issue with REST SSE resubscription to completed tasks. |
rest/stream-message-only | Stream Message Only | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/stream-task-lifecycle | Stream Task Lifecycle | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
rest/multi-turn-context-preserved | Context Preserved | HTTP error for /v1/message:send! Status: 404 Not Found. Response: 404 page not found | — |
rest/get-task-with-history | GetTask With History | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | Known: Server returns task with 0 history items. Server may not persist message history for getTask requests. |
rest/get-task-after-failure | GetTask After Failure | HTTP error for /v1/message:stream! Status: 404 Not Found. Response: 404 page not found | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
v03/spec03-send-message | v0.3 Send Message | SDK v0.3 failed: JSONRPCTransportError: JSON-RPC error: method not found (Code: -32601) Data: {"error":"method not found"} | — |
v03/spec03-task-lifecycle | v0.3 Task Lifecycle | SDK v0.3 failed: Error: Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
v03/spec03-streaming | v0.3 Streaming | SDK v0.3 failed: Error: Invalid response Content-Type for SSE stream for message/stream. Expected 'text/event-stream'. | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/subscribe-to-task | SubscribeToTask | Server error -32004: Task is in a terminal state and cannot be subscribed to. | — |
jsonrpc/get-task-with-history | GetTask With History | historyLength=0 | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/subscribe-to-task | SubscribeToTask | HTTP status client error (404 Not Found) for url (http://localhost:5100/spec/tasks/6ffa79c24ae94ab080b9898e4355e330:subs... | — |
rest/get-task-with-history | GetTask With History | historyLength=0 | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
jsonrpc/spec-extended-card | Extended Agent Card | error: internalError(message: Optional("HTTP 404")) | — |
| Test ID | Test Name | Failure Detail | Known Issue |
|---|---|---|---|
rest/spec-extended-card | Extended Agent Card | error: invalidResponse(message: Optional("Resource not found (HTTP 404)")) | — |