B .(äbvã@s<ddlmZddlZej ddddddgfg¡d d „ƒZdS)é)Úunicode_literalsNztext,expected_tokensu!à¸„à¸¸à¸“à¸£à¸±à¸à¸œà¸¡à¹„à¸«à¸¡u à¸„à¸¸à¸“u à¸£à¸±à¸uà¸œà¸¡u à¹„à¸«à¸¡cCs"dd„||ƒDƒ}||kst‚dS)NcSsg|] }|j‘qS©)Útext)Ú.0ÚtokenrrúQ/home/dcms/DCMS/lib/python3.7/site-packages/spacy/tests/lang/th/test_tokenizer.pyú sz%test_th_tokenizer..)ÚAssertionError)Zth_tokenizerrZexpected_tokensÚtokensrrrÚtest_th_tokenizersr)Ú __future__rZpytestÚmarkZparametrizerrrrrÚs