Counting Films, Not Tokens: What Indexing 1,466 Movies Taught Us About Bilingual Phrase Dictionaries
#dataengineering #nlp #linguistics #spanish Most vocabulary frequency lists lie to language learners for a simple mathematical reason: they count tokens instead of sources. If a courtroom thriller repeats a legal phrase thirty-five times across ninety minutes, a raw token counter…