After standing up huggingface's speech-to-speech pipeline (https://github.com/huggingface/speech-to-speech) I'm really impressed with it's performance! The little demo app works alright, and pointing the pipeline to a reasonably smart model like Deepseek V4 Flash on my dual-spark cluster seems genuinely useful, but it seems like there are not a lot of clients for this setup yet.
Open-WebUI doesn't support it, although there is a fork of open-webui https://github.com/rbb-dev/open-webui/pkgs/container/open-webui-realtime that I may try, but don't really want to go down the fork-route for a major part of my stack.
I