I've been on a binge finding uses for local AI on my machine outside of general LLM usage as I'm not sure what other sub discovery of these things should go on. Here's a collection of my findings.
I'd appreciate other contributions that are off the beaten path or collections.
Somewhat "common" apps / models
invaluable voice to voice translation app. Was quite easy to find a voice online and map it from one to another. Used it to clean up some crappy lecture recordings. What you use if you want to make a recording sound like Obama.
great for converting any sort of text into audio using a variety of locally running models. Things like transcripts to ebooks. Comes with good tools to parse certain upload types. Used it to make an audiobook out of an EPUB.
I know lots of people use this, but there's also a Desktop version in beta. I hate running containers or severs or what have you so this eases a lot of the headache.
There are also settings that allow you to use TTS models and STT models so you can have a vocal conversational experience.
A good hosting program for a bunch of AI apps. Good for if you want to just click, try something out, and then dip. Irritating though as lots of apps crash. Look for something with a high amount of checkins. Also a good interface for running Open Web UI.
easy speech to text for vocal transcription.
Apps / Models I've seen less mentioned
Seems like a model pipeline manager, I just can't understand the ecosystem enough to use it with local models. I'm not sure if I have to do a lot of installation myself or how its plugin architecture works. Whenever I look at external plugins they seem to mostly be in chinese w/ english translations and have fewer stars than normal so I'm never sure if I'm doing the right thing. Spent an hour on it.
this one is good but a PITA. You have to look at your system monitor to see that it's actually using the GPU and you have to install the latest BETA from the site. The settings are also convoluted. Fails silently a lot.
Meetily - Oddly hard to find closed caption model.
You'd think this would be the first thing people would use STT for, but oddly it's hard to find something realtime. Handy is more for text input rather than closed captioning.
Neat package for voice upscaling, but I feel like something better ought to exist.
Long Form Speech Transcription
Parakeet 0.6b / VibeVoice / CohereTranscribe
I don't know why people keep touting whisper. These are more accurate, hallucinate less, and or run faster, or provide more features ( speaker tagging and voice activation ). Feels like GIMP vs. Krita. Whisper hallucinates because it's train off Youtube data.
It's odd that more leaderboards on hugging face aren't posted here. Oddly I feel as though most ASR frontends are geared towards smaller things.
Obscure Examples
Takes music, generates a midi file
Porn classification.
Speakr - Seems to require a lot of config as well
Might need a separate compose setup to spin it up with corresponding models and take it down. For OCD note taking essentially.
Things I've been looking for
Gallery to slideshow
I've found this feature a lot in google photos and Samsung gallery. Something like an AMV generator like the old 2000s youtube channels would ma
AI video editing
Something where I can put in clips and it gives me processing options. Things like action tagging, topic transitions, silence and vocal activity, etc.
Voice Cloning -> singing :
Applio seems great for that but I'm figuring out how to "train" a voice in the format it requires. I'd be nice to have a tool that uses 30 second one shots like other tools, but I don't know if that'll reduce quality.
Speech editing
I've had lots of recorded audio where I'd like to get a transcript and re-type a part of my speech to make it seem natural without having to re-record.
Good image / video / text search front-end
I just want to tag and organize things ideally through embeddings where possible. Just something I can double click, configure, and point at a folder.
Spoken Audio Cleanup
Also oddly hard to find? There are stem separation tools, but it feels like this needs its own unique pipeline. Not sure which models are best for this.
Batch transcription front-end with cleanup pipeline
Something that can go Audio cleanup -> voice activation -> asr -> transcription -> output format ideally but anything with batch transcription would be great. Odd that this doesn't exist.
Generally the "Ollama" for other means
General AI packages and pipelines for things like audio production, conversation analysis, etc.
Discovery Methods
Searching through AI related repository stats
- local-ai, speech-to-text, semantic-search, speech-enhancement
** Alternative To ** https://alternativeto.net/ Used to find open source alternatives to popular software
If you have any suggestions to discovery methods, obscure models, or other comprehensive model packaging tools I'd appreciate you sharing them! Ideally things with
- decent communities
- more recent / capable models
- alternatives to popular paid tools.
[link] [comments]
