tree 43c0eb12a4b13b4d9351666e44024c43dbb71d63
parent 38411997b3ce4a6721f2942ebf0fc67131d94b6e
author Josh Bleecher Snyder <josharian@gmail.com> 1747847704 +0000
committer Josh Bleecher Snyder <josharian@gmail.com> 1747857409 -0700

llm/oai: add entry for Mistral Devstral model

Add the Mistral Devstral coding model (devstral-small-2505) to the llm/oai package.
This model is designed specifically for software engineering tasks and is available
through the Mistral API at the same cost as Mistral Small 3.1.

See: https://mistral.ai/news/devstral

However, we can't actually use it, because the Mistral API
doesn't parse out tool calls, and the model generates at least
three different tool calls formats. None of which contains a tool_call_id,
which somehow the Mistral API requires on the way back in.
I don't understand how this is supposed to work.
But fighting it now is an utter waste of time.

Co-Authored-By: sketch <hello@sketch.dev>
Change-ID: sf3b4fcfc4b26e3b4k