Skip to content

Router Choosing low priority model when healthy higher priority models available #120

@jammin1911

Description

@jammin1911

I think the screenshot below tells the story but you can see that the router is choosing to use oss 120b when it is very low on the priority list and there are plenty of healthy models available that are higher ranked than gpt oss 120b.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions