Skip to content

LLM inference in C/C++

C++ ggml
164 B
Raw Blame
--extra-index-url https://download.pytorch.org/whl/cpu
torch
torchvision; platform_machine != "s390x"
transformers
huggingface-hub
accelerate
sentence-transformers