Skip to content

armgit / janas

Public Imported from GitHub
0

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

NameLast commit date
..
win
aligned.h
audio_aac_ps.c
audio_aac_sbr.c
audio_aac_tab.h
audio_aac.c
audio_aac.h
audio_alac.c
audio_fft.c
audio_fft.h
audio_flac.c
audio_mkv.c
audio_mp2.c
audio_mp3.c
audio_mp4.c
audio_mpa_tab.h
audio_mpa.h
audio_ogg.c
audio_ogg.h
audio_opus_celt.c
audio_opus_silk.c
audio_opus_tab.h
audio_opus.c
audio_opus.h
audio_vorbis.c
audio_wav.c
audio.c
audio.h
catalog.c
catalog.h
deflate.c
deflate.h
devices.c
devices.h
env_names.c
env_names.h
hf_download.c
hf_fetch.c
hf_fetch.h
hf_safetensors.c
hf_safetensors.h
image_jpeg.c
image_png.c
image_resize.c
image.c
image.h
inflate.c
inflate.h
mcp_client_http.c
mcp_client.c
mcp_client.h
mcp_config.c
mcp_config.h
mcp_content.c
mcp_http.c
mcp_http.h
mcp_policy.c
mcp_policy.h
mcp_rpc.c
mcp_rpc.h
mcp_server.c
mcp_server.h
mcp_stdio.c
mcp_stdio.h
mcp_tls.c
mcp_tls.h
md5.c
md5.h
model_pick.c
model_pick.h
npu_ir.c
npu_ir.h
npu_ze.h
npu.c
npu.h
pool.c
pool.h
proc_win.c
proc.c
proc.h
reopen.c
reopen.h
sandbox.c
sandbox.h
sha256.c
sha256.h
sock.c
sock.h
stop.c
stop.h
sysinfo_os.h
sysinfo_win.c
sysinfo.c
sysinfo.h
uring_win.c
uring.c
uring.h
win_compat.c
win_compat.h
win_posix.c
win_start.c
words.c
words.h