B /`@sddlZddlZddlZddlZddlZddlmZmZmZm Z m Z ddl m m ZddlmZddlmZmZddlmZddlmZddlmZddlmZddlZeeZ e e efe e efd d d Z!ee e efee e efd d dZ"GdddeZ#dS)N)AnyListOptionalTextDict)DOCS_URL_COMPONENTS)ENTITIESTEXT)RasaNLUModelConfig)EntityExtractor)Metadata)Message)matchreturncCsT|dddkrB|ddid|ddidd}n|dd}|S)Nvaluetypeintervaltofrom)rr)get)rrr\/home/dcms/DCMS/lib/python3.7/site-packages/rasa/nlu/extractors/duckling_entity_extractor.py extract_values r)matchesrc Cs\g}xR|D]J}t|}|d|d|d|dd|d|d|dd}||q W|S) Nstartendbodytextg?rZdim)rrrr confidenceZadditional_infoentity)rrappend)r extractedrrrrrrconvert_duckling_format_to_rasa s  r"c seZdZdZddddddZdeeeefeeddfdd Z e eeefe ddd d Z eed d d Z eed ddZeeeeefdddZeeeeeefdddZeeedddZeeddddZe deeefeeeededdddZZS) DucklingEntityExtractorzESearches for structured entites, e.g. dates, using a duckling server.N) dimensionsurllocaletimezonetimeout)component_configlanguagercst|||_dS)N)super__init__r+)selfr*r+) __class__rrr-Js z DucklingEntityExtractor.__init__)r*configrcCs |||jS)N)r+)clsr*r0rrrcreateSszDucklingEntityExtractor.create)rcCs<|jds0|jpd}d||}||jd<|jdS)Nr'z{}_{})r*rr+formatupper)r.r+Z locale_fixrrr_localeZs    zDucklingEntityExtractor._localecCs"tjdrtjdS|jdS)zBReturn url of the duckling service. Environment var will override.ZRASA_DUCKLING_HTTP_URLr&)osenvironrr*)r.rrr_urlcs  zDucklingEntityExtractor._url)rreference_timercCs,|jd}|||jdt||dS)Nr%r()rr'tzZdimsZreftime)r*r6rjsondumps)r.rr:r%rrr_payloadjs   z DucklingEntityExtractor._payloadc Cst|d}yh|||}ddi}tj||||jdd}|jdkrR| St d|d|jd |j gSWn>tj jtj jfk r}zt d |gSd }~XYnXd S) aSends the request to the duckling server and parses the result. Args: text: Text for duckling server to parse. reference_time: Reference time in milliseconds. Returns: JSON response from duckling server with parse data. z/parsez Content-Typez0application/x-www-form-urlencoded; charset=UTF-8r))dataheadersr)z9Failed to get a proper response from remote duckling at 'z. Status Code: z . Response: aFailed to connect to duckling http server. Make sure the duckling server is running/healthy/not stale and the proper host and port are set in the configuration. More information on how to run the server can be found on github: https://github.com/facebook/duckling#quickstart Error: {}N)endpoints_utilsZ concat_urlr9r>requestspostr*r status_coder<loggererrorr exceptionsConnectionError ReadTimeoutr4)r.rr: parse_urlpayloadr@responseerrr_duckling_parsets*   z'DucklingEntityExtractor._duckling_parse)messagerc Cs`|jdk rPyt|jdStk rN}ztd|j|Wdd}~XYnXttdS)Niz\Could not parse timestamp {}. Instead current UTC time will be passed to duckling. Error: {})timeint ValueErrorloggingwarningr4)rPrNrrr_reference_time_from_messages z4DucklingEntityExtractor._reference_time_from_message)rPkwargsrcKs|dk rH||}||t|}t|}|jd}t||}ng}t j j j j dtdd||}|jt|tg|dddS)Nr%zDuckling HTTP component in pipeline, but no `url` configuration in the config file nor is `RASA_DUCKLING_HTTP_URL` set as an environment variable. No entities will be extracted!z#DucklingEntityExtractor)ZdocsT)Z add_to_output)r9rVrOrr r"r*r#Zfilter_irrelevant_entitiesrasaZsharedutilsioZ raise_warningrZadd_extractor_namesetr)r.rPrWr:rZ all_extractedr%r!rrrprocesss       zDucklingEntityExtractor.process)meta model_dirmodel_metadatacached_componentrWrcKs|r|dnd}|||S)Nr+)r)r1r]r^r_r`rWr+rrrloads zDucklingEntityExtractor.load)NN)NNN)__name__ __module__ __qualname____doc__defaultsrrrrr- classmethodr r2r6r9rRr>rrO staticmethodr rVr\r ra __classcell__rr)r/rr#6s2   -r#)$rQr<rTr7rCtypingrrrrrZrasa.utils.endpointsrYZ endpointsrBZrasa.shared.constantsrZrasa.shared.nlu.constantsrr Zrasa.nlu.configr Zrasa.nlu.extractors.extractorr Zrasa.nlu.modelr Z%rasa.shared.nlu.training_data.messager Zrasa.shared.utils.iorX getLoggerrbrFrr"r#rrrrs$