AI

6197 readers

19 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 5 years ago

Voxtral Realtime 4B Pure C Implementation (github.com)

submitted 23 hours ago* (last edited 23 hours ago) by Ladislawgrowlo@lemy.lol to c/artificial_intel@lemmy.ml

0 comments fedilink hide all child comments

Speech to text model inference in pure C.

This is a C implementation of the inference pipeline for the Mistral AI's Voxtral Realtime 4B model. It has zero external dependencies beyond the C standard library. The MPS inference is decently fast, while the BLAS acceleration is usable but slow (it continuously convert the bf16 weights to fp32).

Audio processing uses a chunked encoder with overlapping windows, bounding memory usage regardless of input length. Audio can also be piped from stdin (--stdin), or captured live from the microphone (--from-mic, macOS), making it easy to transcode and transcribe any format via ffmpeg. A streaming C API (vox_stream_t) lets you feed audio incrementally and receive token strings as they become available.

Similar projects: Whisper.cpp

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here