Conversational AI v2.13 release - #1106
Merged
Merged
Conversation
…v2.8.1 Port the Agents SDK half of CN source PR #2074 (the REST API half shipped in #1039): - Custom tools and filler words guides: add Python, TypeScript, and Go tabs. Generated filler words no longer require a static fallback, and llm_provider stays undocumented per the CN source. - v2.12 release notes: generic feature entries, with per-SDK tabs under API changes. - Go, Python, and TypeScript SDK references: tools fields, think append, filler word aliases, and the OpenAI GPT-Live MLLM vendor. Audit all three SDK references against Agents SDK v2.8.1 and fix signatures that no longer compile or run: NewAgent/Agent now require a client, sessions come from CreateSession/create_session/createSession without a client argument, WithName/name are removed, and token utilities take a numeric uid. Also correct package names, vendor fields, token defaults, and error types. Fix related samples on other pages: add the endpoint URL that OpenAI requires with an API key (mcp-tools, custom tools), fix managed-mode samples, and correct SDK install names and the token example on the authentication page. All SDK code samples were compiled or run against the published v2.8.1 packages. Apply a Google style guide pass across the changed text. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Vercel PreviewPreview URL: https://docs-portal-k3rtet2fa-agora-gdxe.vercel.app |
Add Smallest AI as an ASR and TTS provider: model pages, meta.json entries, both OpenAPI vendor enums and their description lists, and SDK reference entries for all three Agents SDKs. Field names and types verified against the engine-v2.13 SDK branches; Go and TypeScript samples compile and the Python sample serializes to the documented REST body. Also add v2.13 release note coverage for Smallest AI, OpenAI GPT-Live (early access preview), and Gemini ASR API changes. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
…v2.13-release Takes the SDK reference additions (GeminiSTT, OpenAIGPTLive) and the custom-tools, managed-mode, mcp-tools, and authentication updates. Keeps this branch's version of three files, because #1099 predates the decision that the CN v2.13 parameter tables supersede the SDK definitions and would otherwise reintroduce removed fields: - filler-words.mdx: #1099 restores trigger.mode and fallback_strategy in the samples and makes static_config optional in generated mode. - rest-api.en.yaml: same required-to-optional flip, plus 4 fallback_strategy additions. - release-notes.mdx: v2.13 entry kept; #1099's v2.12 rewrite is merged in. Conflict resolution in go.mdx and typescript.mdx keeps #1099's new content and rewrites its FillerWordsConfig paragraph so it no longer claims the static fallback is optional or that fallback_strategy exists. Also fixes a broken anchor imported from #1099: python#thinktext- had a trailing hyphen, but the heading slugs to thinktext. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Custom tools for MLLM agents: - Add `mllm.tools` to the OpenAPI spec. The engine's API definition already declares `Mllm.tools` as `LlmTool[]`, identical to `Llm.tools`, so the schema mirrors it; verified structurally equal ignoring prose. - The `llm.tools` callout no longer lists MLLMs as unsupported and points to `mllm.tools` instead. - custom-tools.mdx: the prerequisite no longer excludes MLLMs, and a note tells MLLM readers the page applies to them. Correct MLLM MCP support in mcp-tools.mdx. The note claimed the Agent SDKs don't expose MCP on their MLLM vendor classes. All three SDKs do as of v2.11.0, verified by compiling each vendor; Go uses `McpServers` except on `NewOpenAIGPTLive`, which uses `McpServerConfigs`. Remove stale preview routing. GPT Live and the two Gemini 3.8 Live models moved to the production gateway in SDK v2.10.0, so the preview endpoint and `agora-feature` header admonitions were wrong. Gemini TTS remains the only preview-gated vendor and keeps its admonition. GPT Live keeps its real limitations (no turn detection or input audio transcription). v2.13 release notes: custom tools for MLLM agents as a new feature, SDK MCP support for MLLM agents as an improvement, `mllm.tools` in the REST tab, and a Google-style pass that drops redundant "now" and tightens the wording. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
3 of 10 tasks
5 of 10 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Type of Change
Verification
bun run testbun run types:checkbun run lintbun run buildScreenshots
Notes for Reviewers