Skip to content

LLM inference in C/C++

C++ ggml
193 B
Raw Blame
#!/usr/bin/env bash
curl --request POST \
    --url http://localhost:9931/embedding \
    --header "Content-Type: application/json" \
    --data '{"input": "Hello world today"}' \
    --silent