Artificial intelligence training in low memory
Soup is a Python library that allows fine-tuning of large language models via a single YAML file. It can train models with 8 billion parameters using the layer streaming method on laptop graphics processors with 4 GB memory.
Updates
- September 5, 2026: Stars 4,285 → 5,332, latest release v0.74.0 (September 4, 2026).
- September 1, 2026: Stars 3,235 → 4,285, latest release v0.73.3 (August 18, 2026).
- August 27, 2026: Stars 2,222 → 3,235, latest release v0.73.3 (August 18, 2026).
- August 18, 2026: Stars 1,739 → 2,222, latest release v0.73.3 (August 18, 2026).
What you get
- You can train models with 8 billion parameters on laptops with 4 GB graphics memory.
- With the layer flow method, you do not have to deal with complex installations by overcoming hardware restrictions.
- You can manage the entire training process through a single configuration file.
Installation
pip install "soup-cli[train]"pip install "soup-cli[all]"Running it
soup init --template chat
soup trainIf you don't write code
I want to train an artificial intelligence model with 8 billion parameters using the Soup library on my computer with 4 GB graphics memory. Help me create a YAML configuration file that enables layer streaming and uses 4-bit quantization. Prepare the content of the soup.yaml file required to start the training process, and then explain step by step how to start the training using this file.
Related dictionary terms
Links
TreScout did not build this tool · we found it in GitHub trends and wrote it up. This page describes the repository as of 2026-08-16: The star count and our text belong to that day, the repository may have changed since. Check the repository link for the current state. This page was machine-translated from the Turkish original · the Turkish version prevails.