File size: 409 Bytes
de332ab
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
'''
Defines the set of symbols used in text input to the model.
'''

# chinese_cleaners
_pad        = '_'
_punctuation = ',,γ€‚οΌοΌŸβ€”β€¦'
_letters = 'γ„…γ„†γ„‡γ„ˆγ„‰γ„Šγ„‹γ„Œγ„γ„Žγ„γ„γ„‘γ„’γ„“γ„”γ„•γ„–γ„—γ„˜γ„™γ„šγ„›γ„œγ„γ„žγ„Ÿγ„ γ„‘γ„’γ„£γ„€γ„₯γ„¦γ„§γ„¨γ„©Λ‰ΛŠΛ‡Λ‹Λ™ '

# Export all symbols:
symbols = [_pad] + list(_punctuation) + list(_letters)

# Special symbol ids
SPACE_ID = symbols.index(" ")