Mistral, Picked for the Job

For German, the test was a language. One user said that for German specifically they have had "good results" with Mistral Medium 3.5 128B, though it is not exactly in the same class as Qwen 3.6 27B and 35B, and suggested trying Ministral 3 14B. Another, writing about Mistral Small 4 119B, said the problem was not the language, since both variants produced correct German. The difference was in the stories: the Unsloth variant produced "flat" ones when asked to write them, while other quantizations produced "lively longer stories." For this user, correct German was the entry requirement and liveliness was the test.

A job that has been cut down to size suits a small model. One user built a tiered classifier for a stream of network alerts, with a tunable prefilter in front, after the alerts came faster than they could read and they started ignoring the dashboard entirely, which "kind of defeats the point." Their model is stock Mistral 7B with prompt engineering, which "works but makes mistakes" that a fine-tuned model wouldn't. A commenter on small models wrote that the shift that unlocks adoption is not "which model is smartest" but "the narrowest task I can hand off," and that Phi-4 or Mistral Small for classification or extraction can be cheaper than routing everything through a frontier model.

Small machines call for small Mistral models. One commenter told someone building local AI to try smaller models like Mistral 7B or Llama 3 8B and to expect slower inference on the GPU, and another, answering for a machine with 8GB of RAM, said Ollama makes running models like Phi-3 or Mistral-7B-Instruct "very straightforward." In these posts the hardware sets the limit, and the Mistral model is the one that fits under it. Someone running Home Assistant recommended Mistral 7B at q8_0 and called Mistral "pretty snappy," while a user on a Windows laptop said CPU inference is the fastest but "generates a ton of heat and drains the battery quickly," and uses Adreno OpenCL inference only on smaller dense models like Mistral Small 24B or Nemo 12B. Age is no bar: one commenter wrote that Mistral Nemo from 2024 "still works and people use it," and that "You can use local models forever - with new, better software."

Mistral Medium, the larger model, comes up as a question of room. One user laying out what each tier of memory can run said a multi-card setup with 128GB is not enough for MiniMax M2.7 and should be able to run Mistral Medium 128B, but that it is "gonna be slow" and "you are stretching it a bit," and another asked "How good is mistral medium? Would it be worth trying it at Q2" and added a laughing emoji. The verdicts that came with Medium were short: one wrote "I really need to download mistral medium 3.5," another posted "Mistral Medium 3.5 is the Best model. TY!" and someone who tested it with some prompting said it made a long how-to about "How to cause the apocalypse," and added "lmao." The doubts come with a reason in hardware. The praise comes without one.

The week before, Mistral came up as something to fix and measure. One post said its authors had worked with Mistral to fix a config bug in Medium 3.5 that "EVERYONE had," and another user said that of the AI coding tools they tried, only Mistral Vibe constantly had problems applying changes. Someone who keeps testing new 120B-class models against GLM-4.5-Air said the most recent was Mistral Medium 3.5 128B. Compared with the week before, this week's Medium posts turn from repair and testing against rivals to whether it fits a machine and a one-line verdict.

A narrow job also makes the gap visible. The classifier's author knows what the small model lacks: fine-tuning on data from their own alert source is the piece they have not done, and retrieval over the Suricata user guide is an idea for the next version. The model has no real context about what a signature category means beyond the alert payload, they wrote, so it is "reasoning from first principles every time." The fix they describe is more context around the same small model, not a bigger one. A verdict such as "is the Best model. TY!" gives its reader no such handle.