Skip to content

Feat: Improved fault tolerance for smaller models #6

Description

@ntegrals

Is your feature request related to a problem? Please describe.
The current way to parse commands heavily relies on consistent output format generated by the LLM. If the LLM deviates from that structure, the application won't be able to reliably build applications any more.

Describe the solution you'd like
There should be a fallback when a command (e.g. dec-write) fails, and a good way to test if smaller models work reliably with the current system prompt.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions