feat: use env variable to enable ai sdk

[uinstinct]

Description

use CONTINUE_USE_AI_SDK=1 as environment variable to enable the ai sdk on openai or anthropic providers.

requires #10642 to be merged first

AI Code Review

• Team members only: AI review runs automatically when PR is opened or marked ready for review
• Team members can also trigger a review by commenting @continue-review

Checklist

• [] I've read the contributing guide
• [] The relevant docs, if any, have been updated or created
• [] The relevant tests, if any, have been updated or created

Screen recording or screenshot

[ When applicable, please include a short screen recording or screenshot - this makes it much easier for us as contributors to review and understand your changes. See this PR as a good example. ]

Tests

[ What tests were added or updated to ensure the changes work as expected? ]

---

Continue Tasks: ❌ 7 failed — View all

---

Summary by cubic

Adds an opt-in path to use the Vercel AI SDK for OpenAI and Anthropic by setting CONTINUE_USE_AI_SDK=1. Updates adapters, tool/message conversions, and streaming to the SDK’s v6 formats.

• Dependencies

  • Upgrade ai to v6 and @ai-sdk/* to v3.
  • Use createAnthropic; update params (maxOutputTokens) and usage fields (inputTokens/outputTokens).
  • Switch tool and stream formats to v6 (inputSchema, input, tool-input-*, reasoning-delta, finish.totalUsage). Embedding inputs are coerced to strings.

• Migration

  • Set CONTINUE_USE_AI_SDK=1 to enable. Only openai and anthropic are routed through the SDK.
  • Ensure a model is set in the provider config.
  • If passing tool schemas directly, the top-level schema must be type: "object".

^{Written for commit 87d99de. Summary will update on new commits.}

[haystack-code-reviewer-pr-hook]

Try Haystack Code Reviewer

Want AI-powered code review for this PR? Get instant analysis, interactive visualizations, and actionable insights.

Review this PR with Haystack

[cubic-dev-ai]

No issues found across 8 files