B .(b"@s`ddlmZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZmZdd lmZdd lmZdd lmZddlZddlZd dlmZddZddZejdddgddZ ddZ!ddZ"ddZ#ddZ$d d!Z%ejdd"d#d$gejd%ee gd&d'Z&d(d)Z'd*d+Z(d,d-Z)d.d/Z*d0d1Z+d2d3Z,dS)4)unicode_literalsN)displacy)English)Japanese) MultiLanguage)Language)Matcher)DocSpan)Vocab)pickle)link_vectors_to_models)get_docc Csnt}|d}tt|WdQRX|||d}|jsJt| ddg}t |}|jsjtdS)zETest the tagger sets is_tagged correctly when used via Language.pipe.taggerNz hello worldZhelloworld) r create_pipepytestZwarns UserWarningbegin_trainingadd_pipeZ is_taggedAssertionErrorpipenext)nlprdocZdocsZ piped_docrY/home/dcms/DCMS/lib/python3.7/site-packages/spacy/tests/regression/test_issue2501-3000.pytest_issue2564s    rcs|dtddjjddg_tj}|ddddggfd d |D}t|td d }t|d ksxtt|ddkst|dj dkstdS)zTest that operator + is greedy.zIt is May 15, 1993.rZDATE)labelZRULE+)ZENT_TYPEOPcsg|]\}}}||qSrr).0_startend)rrr )sz"test_issue2569..T)keyreverse rz May 15, 1993N) r vocabstringsentsraddsortedlenrtext) en_tokenizermatchermatchedr)rrtest_issue2569#s r6r2uABLEItemColumn IAcceptance Limits of ErrorIn-Service Limits of ErrorColumn IIColumn IIIColumn IVColumn VComputed VolumeUnder Registration of VolumeOver Registration of VolumeUnder Registration of VolumeOver Registration of VolumeCubic FeetCubic FeetCubic FeetCubic FeetCubic Feet1Up to 10.0100.0050.0100.005220.0200.0100.0200.010350.0360.0180.0360.0184100.0500.0250.0500.0255Over 100.5% of computed volume0.25% of computed volume0.5% of computed volume0.25% of computed volume TABLE ItemColumn IAcceptance Limits of ErrorIn-Service Limits of ErrorColumn IIColumn IIIColumn IVColumn VComputed VolumeUnder Registration of VolumeOver Registration of VolumeUnder Registration of VolumeOver Registration of VolumeCubic FeetCubic FeetCubic FeetCubic FeetCubic Feet1Up to 10.0100.0050.0100.005220.0200.0100.0200.010350.0360.0180.0360.0184100.0500.0250.0500.0255Over 100.5% of computed volume0.25% of computed volume0.5% of computed volume0.25% of computed volume ItemColumn IAcceptance Limits of ErrorIn-Service Limits of ErrorColumn IIColumn IIIColumn IVColumn VComputed VolumeUnder Registration of VolumeOver Registration of VolumeUnder Registration of VolumeOver Registration of VolumeCubic FeetCubic FeetCubic FeetCubic FeetCubic Feet1Up to 10.0100.0050.0100.005220.0200.0100.0200.010350.0360.0180.0360.0184100.0500.0250.0500.0255Over 100.5% of computed volume0.25% of computed volume0.5% of computed volume0.25% of computed volumezoow.jspsearch.eventoracleopenworldsearch.technologyoraclesolarissearch.technologystoragesearch.technologylinuxsearch.technologyserverssearch.technologyvirtualizationsearch.technologyengineeredsystemspcodewwmkmppscem:cCs||}|stdS)zDCheck that sentence doesn't cause an infinite loop in the tokenizer.N)r)r3r2rrrrtest_issue2626_28350s r7cCs|d}t|dkst|djdks*t|djdks)wordsrr:ZTEST)r ent)stylez<RELEASE>rN)r r r.rrenderr)en_vocabrhtmlrrrtest_issue2728gs rRcCs8|d}|djdkst|d}|djdks4tdS)zFTest that words like 'a' and 'a.m.' don't get exceptional norm values.aramN)Znorm_r)r3rSrTrrrtest_issue2754rsrUcCs\d}dddddddddd ddd d g}d gt|}t||||d }|djdksXtdS)zATest that deprojectivization doesn't mess up sentence boundaries.zHWhen we write or communicate virtually , we can hide our true feelings .r+r:rAr<rrdep)rLheadsdepsN)splitr1rZ is_sent_startr)rPrLr[r\rrrrtest_issue2772zs  r^z-0.23z+123,456u±1lang_clscCs0|}||}t|dkst|djs,tdS)z2Check that like_num handles + and - before number.r:rN)r1rZlike_num)r2r_rrrrrtest_issue2782sr`c Csg}|ddgifgddtdD}t}|d}||xt|D]}||qNW|}xHtdD]<}i}t |x(|D] \}} |j |g| g||dd qWqrWd S) zdTest issue that arises when too many labels are added to NER model. Used to cause segfault. z One sentenceentitiescSsg|] }t|qSr)str)r#irrrr'sz"test_issue2800..inerg?)ZsgdlossesZdropN) extendrangerrrlistZ add_labelrrandomshuffleupdate) Z train_dataZ entity_typesrrdZ entity_typeZ optimizerrcrfZ statementrarrrtest_issue2800s   rmcCs|d}t|dkst|djdks*t|djdksrHN)r1rr2Zlemma_)Z it_tokenizerrrrrtest_issue2822srnc Cs`t|ddgd}ttt|dWdQRXttt|ddWdQRXdS)zATest that a custom error is raised if a token or span is pickled.ZHellor)rLrNr)r rZraisesNotImplementedErrorr dumps)rPrrrrtest_issue2833s   rqcCsdddg}tdd}|jjddtjddd }x$|D]}||}|||d q6Wd |j_t||djd ksxt |djd kst |djd kst |jj ddd kst |jj ddd kst |jj ddd kst dS)zCTest that vectors recover the correct key for spaCy reserved words.ZdogcatZSUFFIXtest_issue2871)Z vectors_name)r<r*)shapef)ZdtyperZ dummy_vectorsr:r)r(N) r ZvectorsresizenumpyzerosZ set_vectornamer Zrankrfind)rLr,Z vector_datawordr$rrrrss   rscCs<y t}Wntk r&tYnX|d}|s8tdS)zTest that `nlp` doesn't fail.upythonが大好きですN)r ImportErrorrskipr)rrrrrtest_issue2901s  r~cCs|d}t|dkst|djdks*t|djdksZ javascriptrrAZjqueryN)r1rr2)Z fr_tokenizerrrrrtest_issue2926sr)- __future__rrZspacyrZ spacy.lang.enrZ spacy.lang.jarZ spacy.lang.xxrZspacy.languagerZ spacy.matcherrZ spacy.tokensr r Z spacy.vocabr Z spacy.compatr Z spacy._mlr rwrjutilrrr6markZ parametrizer7rFrJrRrUr^r`rmrnrqrsr~rrrrrsB