Skip to content

LLM inference in C/C++

C++ ggml
313 B
Raw Blame
export const MS_PER_SECOND = 1000;
export const SECONDS_PER_MINUTE = 60;
export const SECONDS_PER_HOUR = 3600;
export const SHORT_DURATION_THRESHOLD = 1;
export const MEDIUM_DURATION_THRESHOLD = 10;

/** Default display value when no performance time is available */
export const DEFAULT_PERFORMANCE_TIME = '0s';