Repository navigation
Commit 8a796f7
committed
fix(chain-g2p): convert non-eng dicts to tab-separated so DictStep loads them
The six ChainG2p-* *_dict.txt files separate word and phonemes with two (or one) spaces, but PhonemeDict::load only accepts tab-separated lines and silently skips every line without a tab. The dictionaries therefore always loaded EMPTY, every lookup fell to the multig2p model, and the two-pass dict never actually resolved words on these packages (the L2 'non-eng chains hit the dict' test passed, but only because the model coincidentally produced the same phonemes; НЕТ was the counter-example, giving 'y y' from the model instead of the dict's 'nn je t'). Convert the first whitespace run to a tab (verified: only the separator changed, no other corruption). Kor was already tab-separated; Fil is excluded (uppercase dict, no cleaner).1 parent c8c73a6 commit 8a796f7
6 files changed
Lines changed: 224997 additions & 224997 deletions
File tree
- resources/G2pPackages
- Phonetic-Suite-Deu/modules/ChainG2p-Deu
- Phonetic-Suite-Fra/modules/ChainG2p-Fra
- Phonetic-Suite-Ita/modules/ChainG2p-Ita
- Phonetic-Suite-Por/modules/ChainG2p-Por
- Phonetic-Suite-Rus/modules/ChainG2p-Rus
- Phonetic-Suite-Spa/modules/ChainG2p-Spa
0 commit comments