Tag: mistral.rs

  • Simon Willison’s Weblog: W̶e̶e̶k̶n̶o̶t̶e̶s̶ Monthnotes for October

    Source URL: https://simonwillison.net/2024/Oct/30/monthnotes/#atom-everything Source: Simon Willison’s Weblog Title: W̶e̶e̶k̶n̶o̶t̶e̶s̶ Monthnotes for October Feedly Summary: I try to publish weeknotes at least once every two weeks. It’s been four since the last entry, so I guess this one counts as monthnotes instead. In my defense, the reason I’ve fallen behind on weeknotes is that I’ve been…

  • Simon Willison’s Weblog: mistral.rs

    Source URL: https://simonwillison.net/2024/Oct/19/mistralrs/#atom-everything Source: Simon Willison’s Weblog Title: mistral.rs Feedly Summary: mistral.rs Here’s an LLM inference library written in Rust. It’s not just for that one family of models – like how llama.cpp has grown beyond Llama, mistral.rs has grown beyond Mistral. This is the first time I’ve been able to run the Llama 3.2…