B .(ไbK ใ@sddlmZddlmZddlZej dddddd d gfgกd d „ƒZej dd ddddddgfdddddddgfdddddddgfdddddddgfdddddddgfgกdd„ƒZej ddd d!d"d#d$d%d&d'd(d)g กd*d+„ƒZ ej d,d-d.d/d0d1d2gกd3d4„ƒZ dS)5้)ฺunicode_literals)ฺlike_numNztext,expected_tokensu2ืคื™ื™ืชื•ืŸ ื”ื™ื ืฉืคืช ืชื›ื ื•ืช ื“ื™ื ืžื™ืชu ืคื™ื™ืชื•ืŸuื”ื™ืuืฉืคืชu ืชื›ื ื•ืชu ื“ื™ื ืžื™ืชcCs&||ƒ}dd„|Dƒ}||ks"t‚dS)NcSsg|]}|js|j‘qSฉ)Zis_spaceฺtext)ฺ.0ฺtokenrr๚Q/home/dcms/DCMS/lib/python3.7/site-packages/spacy/tests/lang/he/test_tokenizer.py๚ sz:test_he_tokenizer_handles_abbreviation..)ฺAssertionError)ฺ he_tokenizerrฺexpected_tokensฺtokensZ token_listrrrฺ&test_he_tokenizer_handles_abbreviationsru1ืขืงื‘ืช ืื—ืจื™ื• ื‘ื›ืœ ืจื—ื‘ื™ ื”ืžื“ื™ื ื”.uืขืงื‘ืชu ืื—ืจื™ื•uื‘ื›ืœuืจื—ื‘ื™u ื”ืžื“ื™ื ื”ฺ.u1ืขืงื‘ืช ืื—ืจื™ื• ื‘ื›ืœ ืจื—ื‘ื™ ื”ืžื“ื™ื ื”?๚?u1ืขืงื‘ืช ืื—ืจื™ื• ื‘ื›ืœ ืจื—ื‘ื™ ื”ืžื“ื™ื ื”!๚!u2ืขืงื‘ืช ืื—ืจื™ื• ื‘ื›ืœ ืจื—ื‘ื™ ื”ืžื“ื™ื ื”..z..u3ืขืงื‘ืช ืื—ืจื™ื• ื‘ื›ืœ ืจื—ื‘ื™ ื”ืžื“ื™ื ื”...z...cCs"||ƒ}|dd„|Dƒkst‚dS)NcSsg|] }|j‘qSr)r)rrrrrr -sz3test_he_tokenizer_handles_punct..)r )r rr r rrrฺtest_he_tokenizer_handles_punctsrz text,match)ฺ10T)ฺ1T)z10,000T)z10,00T)z999.0T)uืื—ื“T)u ืฉืชื™ื™ืT)u ืžืœื™ื•ืŸT)uื›ืœื‘F)๚,F)z1/2TcCs.||ƒ}t|ƒdkst‚|dj|ks*t‚dS)N้r)ฺlenr r)r rฺmatchr rrrฺtest_lex_attrs_like_number1srฺwordu ืฉืœื™ืฉื™u ืžืœื™ื•ืŸu ืขืฉื™ืจื™uืžืื”uืขืฉืจu ืื—ื“ ืขืฉืจcCst|ƒs t‚dS)N)rr )rrrrฺ)test_he_lex_attrs_like_number_for_ordinalGs r) ฺ __future__rZspacy.lang.he.lex_attrsrZpytestฺmarkZ parametrizerrrrrrrrฺsL