← Discover
Discover · GitHub · Magnitude↑ +161 today

Run local AI models on your computer

Magnitude is an open-source inference server that integrates with existing AI agents and allows you to run local models suited to your hardware. It works compatibly with coding assistants like Cline and various open-source models, making it easy to leverage local computing power.

Updates

  • September 9, 2026: Stars 4,128 → 4,213, latest release @magnitudedev/cli@0.0.14 (September 8, 2026).
  • September 8, 2026: Stars 3,348 → 4,128, latest release @magnitudedev/cli@0.0.13 (September 8, 2026).
  • September 6, 2026: Stars 2,098 → 3,348, latest release @magnitudedev/cli@0.0.11 (September 2, 2026).
  • September 4, 2026: Stars 2,098 → 2,098, latest release @magnitudedev/cli@0.0.11 (September 2, 2026).

What you get

  • Automatically identifies the best local models for your hardware
  • Works completely offline without an internet connection
  • Integrates with AI assistants to eliminate token costs

Installation

Install the CLI tool and start the setup
npm i -g @magnitudedev/cli
magnitude setup

If you don't write code

🤖 Paste this into your AI agent (Claude Code · Codex · Antigravity)

Set up local models for me with the Magnitude CLI. Install it with `npm i -g @magnitudedev/cli` (or my package manager), then run `magnitude docs onboarding` and follow the instructions.

Related dictionary terms

LocalInference ServerInferenceTokenCLIArtificial Intelligence
Who it is forSuitable for developers who use coding assistants and want to keep their data on their own computer instead of the cloud.
LicenseApache-2.0

Links

TreScout did not build this tool · we found it in GitHub trends and wrote it up. This page describes the repository as of 2026-09-04: The star count and our text belong to that day, the repository may have changed since. Check the repository link for the current state. This page was machine-translated from the Turkish original · the Turkish version prevails.