Ask HN: What API or software are people using for transcription?

I use whisperfile[1] directly. The whisper-large-v3 model seems good with non-English transcription, which is my main use-case.

I am also eyeing whisperX[2], because I want to play some more with speaker diarization.

Your use-case seems to be batch transcription, so I'd suggest you go ahead and just use whisperfile, it should work well on an M4 mini, and it also has an HTTP API if you just start it without arguments.

If you want more interactivity, I have been using Vibe[3] as an open-source replacement of SuperWhisper[4], but VoiceInk from a sibling comment seems better.

Aside: It seems that so many of the mentioned projects use whisper at the core, that it would be interesting to explicitly mark the projects that don't use whisper, so we can have a real fundamental comparison.

[1] https://huggingface.co/Mozilla/whisperfile

[2] https://github.com/m-bain/whisperX

[3] https://github.com/thewh1teagle/vibe/

[4] https://superwhisper.com/

I really like the MacWhisper macOS desktop app - https://goodsnooze.gumroad.com/l/macwhisper

It runs Whisper (or the newer Whisper Turbo) really well, and you can both drop MP3/MP4/etc files into it or paste in URLs to a YouTube video/podcast URL to kick off a transcription. It exports to text or VTT subtitles or a bunch of other formats. I use it several times a week.

That's a great question, as the transcription stack landscape is evolving quickly. As the founder of an AI collaboration platform (Markhub), we've tested several options for our own internal "AI teammate," MAKi.

Our stack is a hybrid approach, as we've found no single service is best for everything:

For Real-Time & High-Volume Transcription: We use Google's Speech-to-Text API (via Vertex AI). We found its accuracy with various accents and noisy environments to be top-tier, which is critical for turning real-world meeting audio into usable data. It's not the cheapest, but the reliability is worth it for our core product.

For Bundled Transcription + Summarization (What you're asking about): You're right to look at models that can handle this in one go. We use Gemini for this exact purpose. The ability to send an audio file and get back a structured summary, not just a raw transcript, is a huge workflow accelerator. We point our audio data to the model and ask it to not only transcribe but also extract action items, which is a core feature of our platform.

For Local/CLI Batching (As you mentioned): We've had great success with OpenAI's Whisper running in a containerized environment for internal, less time-sensitive tasks. Using a fine-tuned version of Whisper on a dedicated machine for batch processing can be very cost-effective. Your M4 mini should be able to handle the base models of Whisper quite well, especially using a tool like whisper.cpp.

My takeaway: For a production API, a robust cloud service like Google's or a powerful model like Gemini is more reliable. For local or batch processing, a self-hosted Whisper setup is a fantastic and powerful option. Good luck!

Whisper large v3 from openai, but we host it ourselves on Modal.com. It's easy, fast, no rate limits, and cheap as well.

If you want to run it locally, I'd still go with whisper, then I'd look at something like whisper.cpp https://github.com/ggml-org/whisper.cpp. Runs quite well.

I'd love for you to try https://carelesswhisper.app

- Locally running, wrapper around whisper.cpp

- I've done a lot of work on noise profiling, stitching the segments. So when you are speaking for anything >2-3mins, its actually faster than cloud transcriptions. (Accuracy is a few WER off since they are quantized models).

- You can try without paying or putting in CC. After that ~19$ one time. No need to sign up or login.

- BYOK to use your groq, gemini free daily credits to rewrite. Support for thinking models too. can also plug into any locally running LLM.

- Works on my 1st gen M1 without a sweat.

A very worthwhile mention is also Stable-TS: https://github.com/jianfch/stable-ts

Out of the box it can transcribe with Whisper or Faster-Whisper, but it can also align audio with an existing human-written transcript, providing time information without losing accuracy. This last feature was something I really needed, and my attempt at building it myself ended up much worse, so I'm glad I found this

I self-host it using Modal.com, as do some other commenters

Just configured VoiceInk yesterday and it's been flawless for all the languages I speak: https://tryvoiceink.com

It runs a small local model and has optional Power Modes that pass the transcript to a remote or local LLM for further enhancements, based on your currently opened apps or websites. Also the app is open-source, but with a one-time license purchase option (instabuy for me, of course).

I have used Azure AI services whisper model and for some other users Google Gemini 2.5

These worked really great for our usecase where we needed to transcribe from 6 different languages in production

Thumbs up for Wispr Flow. Their iOS app was just released last week, and is an interesting addition to the product.

I needed to do an inventory of stuff in our house over the weekend, and I used Wispr Flow on iOS to take a very very long and rambly note in their app. Then the transcription text appeared on their Mac app, ready to be pasted into ChatGPT for parsing.

Wispr Flow handles languages switches quite well in my experience using it in both English and Japanese.

here's a few options cited in this thread:

whisper based options:

whisper.cpp works well on Mac and runs locally, though fine-tuning vocabulary is desired

noScribe is a good FOSS option

MacWhisper is a highly effective macOS desktop app that processes local files and remote URLs, exporting to various formats

whisperfile is suitable for batch transcription and can run on an M4 mini with an HTTP API

carelesswhisper.app is a local, whisper.cpp wrapper that offers fast transcription for longer audio, noise profiling, and one-time payment, working well on M1

Faster-Whisper-XXL standalone on Windows offers fantastic accuracy due to vocal extraction preprocessing

VoiceInk is an open-source solution that runs a small local model with optional remote/local LLM enhancements

Vibe is an open-source alternative to SuperWhisper

Cloud options:

OpenAI speech-to-text and AssemblyAI are considered high quality, with AssemblyAI being cheap and having robust SDK support

TurboScribe offers a generous free tier for web-based transcription

Hosting OpenAI Whisper large v3 on Modal.com provides a fast, cheap solution with no rate limits

AssemblyAI's Universal ASR has impressive WER, future textual prompting, and PII redaction capabilities

borgcloud.org offers competitive pricing and fast real-time transcription

GCP's Chirp & chirp2 are used for large-scale meeting minute transcription

Microsoft Word 365 (online) Transcribe is a surprisingly effective out-of-the-box solution for English, offering labeled speakers and timestamps

Uploading audio to YouTube can be a 'cheap hack' for transcription

Full summary here: https://extraakt.com/extraakts/transcription-tools-and-workf...

A combination of engines generally gets the best WER with additional cost. hosted whisper + gemini 2.5 flash lite with custom deconfliction based on what each one does best is a reasonable path. Gemini does general conversation and silence better than whisper v3 large but whisper v3 large does better specialty vocab. Of course both after and before the merge, common transcription errors are fixed with a dictionary based lookup (that preserves punctuation, etc). This combo stays multi-lingual and is pretty cheap but is complex. There are better single source transcription vendors out there but they generally fail to either provide multi-lingual, or to provide timing info or are ridiculously expensive, or or or... I think the next gen of multi-modal models will make this all moot as they will likely crush transcription. Gemini shows that direction right now. OpenAI does a bad job of it but is in the game. Anthropic is surprisingly not really engaged in this yet (but they did just announce real time audio so they gotta be thinking about it).

I just happen to have a 3 hours recording that needs transcription and I didn't manage with Whisper. It has 3 special characteristics:

-Huge size (400MB), it can be split but then I want a single text file with correct timestamps

- There are 3 speakers and one is speaking far from the microphone and with low voice. Whisper sometimes ignores this speaker.

- The last and more difficult is that there are 2 languages being used at the same time. The same speaker might use Dutch or English and even mix both in a sentence.

Is there a way to deal with all that?

OpenAI speech-to-text. Every time I try to use an open source model I am left unimpressed. If I'm going through the hassle of creating a system it might as well work correctly. At this point the closed source world is still miles ahead of the open world; hopefully that changes in the next year or two.

(Wispr Flow is the best for general TTS on desktop as well.)

For a web UI, I've used TurboScribe and liked it: http://turboscribe.ai/. Their free tier allows 3 transcriptions per day for audio/video files up to 30 minutes in length. That was nice as many competing services limit their free tier to 10 minutes.

If you want to support a startup that does not get the bill footed by VC, we made https://borgcloud.org/speech-to-text and the price is competitive to Groq. We have average latency under 1s and do 5x-15x realtime.

I've been using WhisperNotes (https://whispernotes.app) for iOS/macOS and really appreciate the offline approach - no recurring API costs and everything stays local. The transcription quality is solid, though you're right that it doesn't handle summarization yet. Still worth checking out if privacy and costs matter to you.

Cheap hack I use for transcribing in-person customer sessions:

1. record the audio on your phone audio recorder

2. send the mp3 to yourself in Slack

3. a few minutes later the transcription will appear on Slack

I then feed that to an LLM for summary and actions. Quality has been great for this workflow, all in English.

What are people using for realtime transcription and diarization specifically? I'm thinking something like Zoom's transcript feature but Zoom itself has the advantage of knowing exactly who is speaking at what time so they don't need to diarize from raw speech at all.

So far I've seen DiCoW-v2 work pretty well, it's a diarization finetuned Whisper [0], also paid options like Speechmatics work well and are fairly cheap.

[0] https://pccnect.fit.vutbr.cz/gradio-demo/

Faster-Whisper-XXL standalone executable on Windows: https://github.com/Purfview/whisper-standalone-win

AssemblyAI's Universal ASR has got really impressive WER compared to Google Cloud Voice or Nova. I'm looking forward to their rolling out Slam-1's textual prompting, which will let you use plain English to describe the domain/context of the recording. Very reasonably priced. I've used it on about 10,000 speech hours for a service I built. As a bonus, it also can produce PII redacted audio files and transcripts for a very reasonable price. That used to be hugely tedious and expensive work.

Microsoft Word 365 (online) -> Transcribe.

I know, I know - it sounds super cheese, but after trying several different LLMs and workflows, it just worked out of the box and gave me what I needed: labeled speakers, timestamps, and a nice way to review/jump from the generated text to the audio. Didn't work so well for mixed languages, but for English at least it was comparable or better to the other solutions I tried.

Is there anyone using anything that's NOT based on whisper? Maybe some hopefully not-too-ugly kaldi recipe?

Question: In California, it's a two party state for recording, including (i can be wrong) transcribing. How are you handling this? are you handling this or are you just capturing without consent?

I just saw Apple's new live transcribe. I wonder how that works, in a legal sense for two party states.

Bonus question: what API or software are people using for diarization? (On top of transcription)

Is there a way to get transcription without engaging in sound recording, ie on device?

I would really like to get transcription of my meetings without having the legal implications or notification requirements of sound recording.

This wrapper for whisper.cpp https://github.com/akash-joshi/better-whisper

Something that I built myself using MacOS's speech recognizer:

http://transcribetranslate.app/

AssemblyAI is quite good, pretty cheap and easy with robust SDK support.

https://www.assemblyai.com/

Chirp & chirp2 on GCP cloud speech-to-text-v2 api . I transcribed about 1000+ hours of meeting minutes from public records

I use whisper.cpp and it works pretty okay on a mac. Runs locally. Wish i could finetune its vocab.

I would love to automate our Youtube channel videos and transcribe with speaker identification

I'm using VoiceInk which is great and open-source (free if you build it yourself!)

Honestly if it were me and I wanted "fast and cheap" I would just upload all content to YouTube and let them pay for and upkeep the AI transcription models.