Skip to content

[BUG] Mixing models between configuration profiles #9169

@ante-maric

Description

@ante-maric

Problem (one or two sentences)

When two configuration profiles are created, both with LiteLLM API provider but different instances (different base url), list of models are not always pulled from currently selected one, causing an issue when they don't provide the same models (The model ID (some-model) you provided is not available. Please choose a different model.).

Context (who is affected and when)

Happens to everyone that needs to use multiple configuration profiles with different LiteLLM instances (possibly this happens for other providers too).

Reproduction steps

  1. Add two configuration profiles that use LiteLLM provider but different instances (base url) with different models
  2. Switch between profiles and try to refresh models
  3. Model list is always pulled from one of the providers which isn't necessarily currently selected one.

Expected result

Configuration profiles are independent and getting list of models uses API provider from currently selected configuration profile.

Actual result

List of models is not always pulled from API provier that is configured for the currenly selected configuration profile.

Variations tried (optional)

No response

App Version

v3.31.0

API Provider (optional)

LiteLLM

Model Used (optional)

No response

Roo Code Task Links (optional)

No response

Relevant logs or errors (optional)

Metadata

Metadata

Assignees

Labels

Issue - In ProgressSomeone is actively working on this. Should link to a PR soon.bugSomething isn't working

Type

No type

Projects

Status

Issue [In Progress]

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions