HuggingFace's Open ASR Leaderboard added Hindi and Indian English benchmarks on August 28 through a partnership with VoiceArena, making these the first Global South languages on the leaderboard.
The two benchmarks, named Monsoon hi and Monsoon en-IN, cover 4,888 speakers across four speaker-disjoint splits, with audio recorded on speakers' own phones during spontaneous conversation rather than in studio conditions. Each language includes a public split for self-scoring and a private held-out split, with OIWER used against reference lattices to handle variation in written transcription.