Releases

Olla v0.0.28

Olla v0.0.28 is a big release: native oMLX support for fast multi-model inference on Apple Silicon with Anthropic passthrough, per-endpoint authentication for local backends, opt-in CORS for browser clients, and a round of Anthropic translation and reliability hardening.

• Native oMLX support
• Docker Model Runner Anthropic passthrough
• Lemonade models are now routable
• OpenAI alias fixes

Olla v0.0.27

We've added native support for LMDeploy after so long as well as bugfixes for sticky sessions thanks to @lbatalha.

• Add aimock test harness for sticky sessions
• Add language tags to skill code fences
• Add lmdeploy backend docs
• Add lmdeploy model converter and wire into factory and routes

Olla v0.0.26

This is a bugfix release that addresses SSL connection issues due to mis-handling of the Host header.

• Lets you build docker image locally without goreleaser
• Make docker builds portable across arm and amd

Olla v0.0.25

Olla is a high-performance proxy and load balancer for LLM infrastructure.

• Feat: add model alias validation, test coverage, and byte-preserving JSON rewrite
• Sticky sessions implementation
• Fix(inspector): copy buffer bytes before pool return to avoid aliasing
• Fix(inspector): incremental scan with token-level skipping for field-order independence

olla-v0.0.24

• Feature: Anthropic agent fixes and improvements
• Default to Olla proxy engine
• Fix duplicate increment
• Fix anthropic tooling bug

olla-v0.0.23

• New Backends: Docker Model Runner and vLLM-MLX
• Support for Anthropic Passthrough on supported backends (vllm etc) so we don't translate in Olla
• Documentation Refinements based on feedback
• Sensible defaults so you can have a lean config file to overide for most users

olla-v0.0.22

• Fix: ensure model_url is used from endpoint config
• Chore: december 2025
• Fix: Alternative method of resolving profile paths
• Alternative way to join paths for OpenAI compatible profiles

olla-v0.0.21

• Feat: path preservation for routing in Olla
• Add preserve_path to ep configuration
• Initial profile consolidation
• Introduce url_builder to abstract out the target path building

olla-v0.0.20

Olla v0.0.20 brings back native LlamaCpp integration and introduces experimental support for Anthropic message translation, making it easier to run local models and route Anthropic-style requests through your own infrastructure.

• Feat: Backend llamacpp
• Feat: anthropic / message logger (development only)
• Feat: Anthropic Message format Support
• Prepare: v0.0.20

olla-v0.0.19

• Feat: backend/sglang
• Feat: backend/lemonade
• Fixes: October 2025 performance improvements
• GetHealthyEndpointsForModel could leak targets that no longer exist.