Llama.cpp

Llama.cpp enables large language models to run efficiently on standard hardware.