datasette-llm 0.1a11 adds OpenAI compatible endpoints
The point
datasette-llm 0.1a11 is out. The intermediate Datasette plugin for configuring LLMs for other plugins now supports OpenAI compatible endpoints, so you can point Datasette at an LLM hosted anywhere that talks the OpenAI pseudo standard protocol.
Why it matters
For builders, local models in LM Studio, Ollama, or llama.cpp can now power Datasette agents without a hosted API.
Key details
- Example runs Datasette via uvx with datasette-agent, using a local model named lmstudio-qwen
- The example config sets model qwen/qwen3.8-27b with api_base http://localhost:1234/v1
- llama.cpp is noted in the release as just hitting v1.0.0
Original ~3 min → 25 sec here Source: Simon Willison, Nov 14, 2026