Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Python calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
README and docs: the input limits as plain prose
Nandakishora59dcbc9d564
diff --git a/README.md b/README.mdindex 6405bb65..ae1a9ca3 100644--- a/README.md+++ b/README.md@@ -99,7 +99,7 @@ agent.predict(video="call.mp4", questions=questions) # speechagent.predict_long(seventy_page_contract, questions) # up to 73,728 tokens, read whole```-Image, audio and video, in one paragraph: an image is a PIL image, a path or an HxWx3 array in any format Pillow opens, and it is scaled to about one megapixel (1,048,576 pixels) before the reader sees it, so a larger or sharper file costs nothing more and gains nothing; there is no file-size cap of its own, memory is the bound. Audio is a path or raw file bytes (wav, flac, ogg, mp3, with `pip install soundfile`) or a 1-D numpy waveform with `sampling_rate=`; any length works, stereo is averaged, the wave is resampled to 16 kHz and transcribed in 30-second windows, and the transcript then counts toward the 73,728-token context. The default transcriber is English-only; pass `asr="openai/whisper-tiny", language="hi"` for other languages. Video is a path or raw file bytes in any container ffmpeg opens (mp4, mov, webm, mkv), decoded through the `ffmpeg` binary on your PATH, with no Python dependency; the sound track is extracted at 16 kHz and transcribed, and if the transcript holds real words the decision is made on it through the text path, with heads, calibration, set and route all applying. A silent clip, or one whose sound is music or noise, has `frames` (4 by default) evenly spaced frames tiled into one contact sheet and decided through the image path, which is zero-shot. Any length and resolution work, since only the frames sampled and the transcript reach the reader; `out["video"]` says which path decided, the frame times or the transcript, and the duration.+An image is a PIL image, a path or an HxWx3 array in any format Pillow opens; it is scaled to about one megapixel before the reader sees it, so a sharper file gains nothing, and memory is the only size bound. Audio is a path, raw file bytes (wav, flac, ogg, mp3, with `pip install soundfile`) or a 1-D numpy waveform with `sampling_rate=`, of any length: it is resampled to 16 kHz, transcribed in 30-second windows, and the transcript counts toward the 73,728-token context. The default transcriber is English-only; pass `asr="openai/whisper-tiny", language="hi"` for other languages. Video is a path or raw bytes in any container ffmpeg opens, decoded through the `ffmpeg` binary on your PATH with no Python dependency: the sound track is transcribed and, if it holds real words, decided through the text path with heads, calibration, set and route applying; a silent clip has four evenly spaced frames tiled into one image and decided through the image path, zero-shot. Any length and resolution work, and `out["video"]` says which path decided.**Fit and calibrate on your own labels.** Seconds, no gradient step, and the route line is placed for you:diff --git a/docs/vegaml.md b/docs/vegaml.mdindex 26465722..9ac356cf 100644--- a/docs/vegaml.md+++ b/docs/vegaml.md@@ -85,7 +85,7 @@ agent.predict(video="call.mp4", questions=questions) # speech iagent.predict_long(document, questions) # one pass up to 73k tokens```-Image, audio and video, in one paragraph: an image is a PIL image, a path or an HxWx3 array in any format Pillow opens, and it is scaled to about one megapixel (1,048,576 pixels) before the reader sees it, so a larger or sharper file costs nothing more and gains nothing; there is no file-size cap of its own, memory is the bound. Audio is a path or raw file bytes (wav, flac, ogg, mp3, with `pip install soundfile`) or a 1-D numpy waveform with `sampling_rate=`; any length works, stereo is averaged, the wave is resampled to 16 kHz and transcribed in 30-second windows, and the transcript then counts toward the 73,728-token context. The default transcriber is English-only; pass `asr="openai/whisper-tiny", language="hi"` for other languages. Video is a path or raw file bytes in any container ffmpeg opens (mp4, mov, webm, mkv), decoded through the `ffmpeg` binary on your PATH, with no Python dependency; the sound track is extracted at 16 kHz and transcribed, and if the transcript holds real words the decision is made on it through the text path, with heads, calibration, set and route all applying. A silent clip, or one whose sound is music or noise, has `frames` (4 by default) evenly spaced frames tiled into one contact sheet and decided through the image path, which is zero-shot. Any length and resolution work, since only the frames sampled and the transcript reach the reader; `out["video"]` says which path decided, the frame times or the transcript, and the duration.+An image is a PIL image, a path or an HxWx3 array in any format Pillow opens; it is scaled to about one megapixel before the reader sees it, so a sharper file gains nothing, and memory is the only size bound. Audio is a path, raw file bytes (wav, flac, ogg, mp3, with `pip install soundfile`) or a 1-D numpy waveform with `sampling_rate=`, of any length: it is resampled to 16 kHz, transcribed in 30-second windows, and the transcript counts toward the 73,728-token context. The default transcriber is English-only; pass `asr="openai/whisper-tiny", language="hi"` for other languages. Video is a path or raw bytes in any container ffmpeg opens, decoded through the `ffmpeg` binary on your PATH with no Python dependency: the sound track is transcribed and, if it holds real words, decided through the text path with heads, calibration, set and route applying; a silent clip has four evenly spaced frames tiled into one image and decided through the image path, zero-shot. Any length and resolution work, and `out["video"]` says which path decided.The modality is chosen by which argument you passed; the questions and the answer shape are thesame. An audio answer carries `transcript` and `asr`, because a decision made on words you never