Skip to content

LLM inference in C/C++

C++ ggml
236 B
Raw Blame
// actions accepted by the realtime inference control endpoint (API_CHAT.CONTROL)
// kept separate from the endpoint paths since these are protocol level verbs
export const CONTROL_ACTION = {
	END_REASONING: 'reasoning_end'
} as const;