fix: correct codestral-latest context window from 256k to 131k #10503
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related GitHub Issue
Closes: #9344
Description
This PR attempts to address Issue #9344 by correcting the context window limit for Mistral's codestral-latest model.
The codestral-latest model was incorrectly configured with a context window of 256,000 tokens when the official Mistral documentation specifies it should be 131,000 tokens (128k in practice).
Updated the
contextWindowvalue inpackages/types/src/providers/mistral.tsfrom 256,000 to 131,000.Test Procedure
npm run check-types- passednpm run lint- passednpx vitest run- 139 tests passedPre-Submission Checklist
Documentation Updates
Additional Notes
Feedback and guidance are welcome!