July 12, 2026  ·  Blog

Their Training Data Is Your Training Data

For two decades, humanity recorded itself speaking so that machines could learn to listen. Nobody noticed that the recordings are also the best ear-training material ever assembled for people.

Every speech technology you use — the assistant that hears you, the voice that reads your directions — was trained on the same raw material: enormous collections of real sentences, read aloud by real people, checked against their transcripts. Speech-to-text needed thousands of hours of humans speaking naturally. Text-to-speech needed one voice reading thousands of sentences with obsessive consistency. The corpora exist because the machines could not learn without them, and companies and research labs spent twenty years assembling them.

Here is what those corpora are, seen from the other side: native-speed audio, real voices, real sentence shapes, each clip paired with a verified transcript — at a scale no language course has ever approached. That pairing of sound and truth is precisely what a human ear needs to train against. The machines' training set is a human training set. It was just never labeled that way.

How I found out

I wasn't looking for a philosophy. I was looking for a Romanian bot voice for an ordinary app, and the AWS voice and the Google voice were not worth using. Searching for a third option, I found an academic text-to-speech project — RomanianTTS, from the speech group at Cluj — and behind its synthetic voice, the thing itself: the training data. More than five thousand WAV files of a real speaker reading real Romanian sentences, each one transcribed, recorded so a machine could learn the language's sound.

So I abandoned the bot voice and built a spaced-repetition app around the data instead. Listen to a clip, type what you hear, get graded against the transcript the machine was graded against. I worked through three or four thousand of those five-thousand-odd recordings myself. And somewhere in there the concept clicked: this wasn't a lucky find about Romanian. This was a category. If one TTS project's training data could carry a learner that far, then the whole world of speech-machine training data was sitting there, unclaimed.

Only after I had the concept did I know what to search for — and that is how I found Mozilla Common Voice: millions of validated clips, over a hundred languages, real volunteers reading real sentences, openly licensed. The key to the multi-language version of the same machine. Not a cute collection of yes and thank you that runs dry after a hundred phrases — hundreds of thousands of human-spoken sentences per major language.

The road that didn't work first

I should admit the plan I had before this one, because the mistake is instructive. Like everyone who thinks about corpora, I started from text. Tatoeba. Europarl — a monster, grammatically near-complete, decades of parliamentary proceedings in twenty-plus languages. Even the Bible, which has the loveliest addressing scheme ever devised for spaced repetition: book, chapter, verse. The plan was always some version of: take the great text pile, then somehow conjure the audio — synthesize it with a bot voice, or crowdsource readers, or in the Bible's case what I can only call zeal-sourcing, on the theory that believers would have more motivation than volunteers usually do. None of it survives arithmetic. You are back to the same wall: language learning cannot summon enough voices, whatever the text promises.

The inversion that works is exactly backwards from that instinct: stop starting from text and hoping for audio. Start from the audio that already exists, and re-corpus around it. The recordings are the scarce asset; the machines' researchers already paid for them. Meanwhile, in a completely different domain, working on a completely different problem, a speech group had built precisely what a text-first plan could never afford — and the intersection with human language acquisition, which runs on bulk listening, was sitting there unclaimed.

The discipline you can't fake

And here is the quiet beauty of borrowing from the machines: the machines require transcripts. A speech corpus without verified text is worthless for training — so every clip in these troves arrives with its ground truth attached, checked, corrected, non-negotiable. Which means the material itself forbids the learner's favorite self-deception. You cannot "sort of" understand a clip; you type what you heard and the transcript says otherwise, character by character. Podcasts with crisp edited sound let you nod along for an hour and verify nothing. Dictation against a machine-grade transcript is the stronger trainer for the same reason the corpus exists at all: the machines couldn't be lazy about the truth, and training on their material, neither can you.

Why the machines got better material than you did

Ask why no language course ever assembled a hundred thousand native recordings, and the answer is economics, not imagination. Recording people at scale takes volunteers or money, usually both. Language learning could never summon them — its collections run out after a hundred sentences because nobody shows up to record sentence one hundred and one. Speech recognition and speech synthesis never had that problem, because teaching machines to listen had commercial implications, and money finds volunteers.

The machines never ran out of volunteers. Language learners did. So borrow the machines' volunteers.

The quality difference goes beyond volume. Course audio is written by pedagogues to demonstrate grammar — the boy is good — sentences no human has ever said to another human, spoken at a speed no native uses, by announcers paid to be clear. Corpus sentences are the opposite: they were harvested from real text and read by ordinary people, because the machines needed to survive reality, not a classroom. If you train on classroom audio you can pass the classroom. If you train on what the machines trained on, you can pass the street.

What not to do with it

Two wrong turns, both popular. The first is speak-to-a-bot apps — pointing speech recognition at the learner and calling the transcription feedback. Talking at an STT engine teaches approximately nothing: the bot flatters whatever it can guess, and your ear, the actual bottleneck, never gets trained. The value is not in the machinery. The value is in the machinery's diet.

The second is settling for text piles with bolted-on audio — apps built on crowd-translated sentence collections, where the sentences are flat and the recordings an afterthought. A corpus assembled to train a machine's ear had to be right: verified transcripts, natural sentences, consistent audio. That discipline — imposed by the machines' needs, not by any teacher — is exactly the quality floor a learner should refuse to go beneath.

The grammar you stop needing

A corollary that surprises people: at corpus scale, most grammar study becomes redundant. The principal patterns of how a language builds its sentences show up on their own, hundreds of times each, in a large enough stream of real sentences — the way they did for the machines, which learned the language without ever seeing a grammar table. Transcribe a few thousand real sentences and the constructions are in your hands before you could have named them. What remains for the book is the literary exceptions — and by then you'll recognize them as exceptions.

The blueprint

The idea is bigger than any one app, and it isn't ours to fence off: the troves of machine-learning speech data are reusable for training the human ear. Anyone can build on it. A school could implement it in a weekend and assign it as homework — and schools, unlike apps, can make the practice stick. We built one implementation the way we think it should work: real clips, noise and all, spaced repetition that respects the queue, grading against the machine's own transcripts. But the claim this page exists to make is the simple one: the material has been sitting there for twenty years, paid for by people teaching machines to hear. It also teaches you.

There's a name for the idea, and we liked it enough to register the company under it: human machine learning. The machines' learning, turned human.

SiteDictation is dictation practice built directly on machine-learning speech corpora — Mozilla Common Voice and friends: native-speed clips, verified transcripts, spaced repetition on your misses. Thirty-one languages. Train on the machines' training data →