Skip to content

LLM inference in C/C++

C++ ggml
196 B
Raw Blame
#extension GL_EXT_shader_16bit_storage : require

layout (push_constant) uniform parameter
{
    uint KX;
    uint KY;
    float param1;
    float param2;
    float param3;
    float param4;
} p;