You may want to look into different models that are more accurate and maybe an AEC layer to remove background noise. Or at the very least a RNN de-noiser on the mic channel. Also, you may want to stream audio to the model instead of holding it all in memory and transcribe at the very end as that can potentially allow you to take the app much further than it is now.
I see Claude implemented a very crude upsampling/downsampling algorithm, which is what LLMs usually do when prompted to handle such a problem. But I would suggest restraining the model from implementing DSP processing on their own and instead use battle tested libraries. You can use rubato's FFT Resampler.
Audio processing is genuinely a hard engineering problem, LLMs usually don't get it right. If you decide to get deep into it, the knowledge you'll get is very rewarding.
djx22
So many of these apps in fact that the relevant subreddit has a literal spreadsheet to keep track of them all and if memory serves last time I checked, there were over two dozen entries.
Does no one even check the space before building an app these days? This is almost literally the MOST saturated Mac app in existence…
In fact I will go farther. It is actively bad to release something like this, because it clogs up the space and makes picking an app more difficult for everyone just by virtue of its mere existence adding to cognitive load.
There's so many of these, at this point I've seen 10 clones make the front page each time as if there never existed local only options before.
Also whisper is pretty outdated vs parakeet
zackify
- tonnes of these get released daily but I ll give you the guys on HN an awesome idea
- havent seen a single one on HN yet in the last year (i read HN twice a day like brushing my teeth)
- When I input my voice into the mic, I want an AI voice as output converting my words in real time in AI voice
- Use case: gaming, I have a terrible voice and dont want to do a voice over with that but at the same time I would love to if I could
- Know any github projects capable of pulling this off? maybe direct integration as an OBS plugin would make it godtier
vivzkestrel
Are you running the Moonshine model via ONNX/CoreML or native ggml/mlx bindings? how is the first token latency and memory footprint compared against Whisper small.en on Apple Silicon
roni2k1b
Are you aware of Spokenly? It has a local mode that uses Apple’s built in services. I bind it to right command and use it frequently for hard to spell words.
e40
I see that it changes the menu bar icon to indicate status. How is this communicated when windows are full screen and the menu bar isn’t visible?
itsdesmond
also handy.computer is awesome. local. choose your own model. multilingual. bind to any shortcut. works on arm silica
DzHiBaS
I really need one on the app store or sideload for iOS. I am not a fan of Apple's dictation.
comments (10)
I see Claude implemented a very crude upsampling/downsampling algorithm, which is what LLMs usually do when prompted to handle such a problem. But I would suggest restraining the model from implementing DSP processing on their own and instead use battle tested libraries. You can use rubato's FFT Resampler.
Audio processing is genuinely a hard engineering problem, LLMs usually don't get it right. If you decide to get deep into it, the knowledge you'll get is very rewarding.
djx22
Does no one even check the space before building an app these days? This is almost literally the MOST saturated Mac app in existence…
In fact I will go farther. It is actively bad to release something like this, because it clogs up the space and makes picking an app more difficult for everyone just by virtue of its mere existence adding to cognitive load.
cheesecakegood
ahaferburg
https://tryvoiceink.com/
There's so many of these, at this point I've seen 10 clones make the front page each time as if there never existed local only options before.
Also whisper is pretty outdated vs parakeet
zackify
- havent seen a single one on HN yet in the last year (i read HN twice a day like brushing my teeth)
- When I input my voice into the mic, I want an AI voice as output converting my words in real time in AI voice
- Use case: gaming, I have a terrible voice and dont want to do a voice over with that but at the same time I would love to if I could
- Know any github projects capable of pulling this off? maybe direct integration as an OBS plugin would make it godtier
vivzkestrel
roni2k1b
e40
itsdesmond
DzHiBaS
youniverse