Skip to content

Support providers beyond OpenAI and Anthropic #5

Description

@obakeng-develops

meat supports OpenAI and Anthropic. Supporting other providers, or any OpenAI-compatible endpoint, would widen where it can run.

A few cases where this matters:

  • Models from other labs such as DeepSeek, Kimi, Qwen or Mistral, which are often cheaper for a job like abridging a diff.
  • Corporate accounts on Bedrock, Vertex or Azure OpenAI, where the model is the same but the endpoint and the auth differ.
  • Local models through Ollama or llama.cpp, which matters when the diff comes from a private repo and should not leave the machine.
  • Gateways such as OpenRouter.

OPENAI_BASE_URL already exists, and DeepSeek and Kimi both publish OpenAI-compatible endpoints, so some of this may work today. If it does, the README saying so would help, because the flag list does not make it obvious. The gaps are auth schemes that are not a bearer token, and providers that are not OpenAI-compatible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions