llama.cpp Gains a Realtime Transcription Websocket and a /tts Endpoint
llama-server now speaks OpenAI-style realtime transcription and text-to-speech. Here is how to run it with Voxtral Mini 4B, and what isn't ready yet.
· 3 minTopic
Llama Cpp
Coverage tagged llama cpp.
- Articles
- 1
- Desk
- 1