Fast inference engine for artificial intelligence models
lightseekorg/tokenspeed is a high-performance inference engine developed for large language models (LLMs). Written in Python, this project aims to accelerate the prediction processes of artificial intelligence models.
Updates
- October 16, 2026: Stars 2,608 → 2,613, latest release v0.1.1 (October 6, 2026).
What you get
- offers C++ and Python-based control and execution planes
- operates with high performance for large language models
- includes a plugin mechanism for hardware accelerators
Getting started
You can follow the guides on the LightSeek website to review the official documentation and get started step by step.
Related dictionary terms
Links
TreScout did not build this tool · we found it in GitHub trends and wrote it up. This page describes the repository as of 2026-10-16: The star count and our text belong to that day, the repository may have changed since. Check the repository link for the current state. The introductory text was prepared with AI from the repository's own documentation, and this page was machine-translated from the Turkish original · the Turkish version prevails.