# AI server for Mac computers

Omlx is a large language model (LLM) inference server that supports continuous batching and SSD caching for Apple Silicon processors. This tool, managed via the macOS menu bar, offers the opportunity to run high-performance models on local hardware.

- ★ 21,147
- Python
- GitHub Trending · 2026-08-18

## What you get
- Running high-performance models on Apple Silicon processors
- Efficient memory management with SSD caching
- Easy server control from the menu bar

## Installation
**Installation with Homebrew**

```
brew tap jundot/omlx https://github.com/jundot/omlx
brew install jundot/omlx/omlx
```


## Running it
**Starting the background service**

```
omlx start
```


## If you don't write code
I manage large language models through my oMLX server running on my local Apple Silicon hardware. Recommend the best configuration settings that will allow me to optimize memory usage and improve model performance using continuous stacking and SSD caching. Also, explain how I can use the KV cache most efficiently when switching between my current models.

## Related dictionary terms

## Links
- GitHub repository →
- Read in Turkish →

---
Source: TreScout Discover · https://trescout.com/en/discover/omlx/