B /`3@sddlZddlmZmZmZmZmZmZmZddlZddl Z ddl Z ddl m Z ddlmZmZmZmZmZmZmZmZmZmZmZmZmZddlmZejrddlm Z GdddZ!dS) N)AnyOptionalTupleTextDictSetList) RasaException) TEXTINTENTRESPONSEINTENT_RESPONSE_KEYMETADATAMETADATA_INTENTMETADATA_EXAMPLEENTITIESRESPONSE_IDENTIFIER_DELIMITERFEATURE_TYPE_SENTENCEFEATURE_TYPE_SEQUENCE ACTION_TEXT ACTION_NAME)DIAGNOSTIC_DATA)Featuresc @szeZdZd;eeeefeeeeeededdddZ edddddZ eeeefdd d d Z dedddZe dddZedddZedddZed?eeeeeeeefeeeeeddddZedd d!Zedd"d#Zeeeeeefd$d%d&Zd@eeeeeededfd'd(d)ZdAeeeeeededfd'd*d+ZdBeeeeedd'd,d-ZdCeeeee d'd.d/Z eeeeededfd'd0d1Z!eeeeededfd'd2d3Z"edDedeeeedd4d5d6Z#e dd7d8Z$e dd9d:Z%dS)EMessageNr)dataoutput_propertiestimefeatureskwargsreturncKsX||_|r|ni|_|r |ng|_|jjf||r@||_nt|_|jtdS)N) rcopyrrupdatersetaddr )selfrrrrrr%T/home/dcms/DCMS/lib/python3.7/site-packages/rasa/shared/nlu/training_data/message.py__init__szMessage.__init__)rrcCs|dk r|j|dS)N)rappend)r$rr%r%r& add_features3szMessage.add_features)originrrcCsH||tikr(tjjjd|d|jti||jt|<dS)zAdds diagnostic data from the `origin` component. Args: origin: Name of the component that created the data. data: The diagnostic data. zIPlease make sure every pipeline component has a distinct name. The name 'zA' appears at least twice and diagnostic data will be overwritten.N) getrrasasharedutilsio raise_warningr setdefault)r$r*rr%r%r&add_diagnostic_data7s  zMessage.add_diagnostic_dataF)propinfo add_to_outputrcCs||j|<|r|j|dS)aSets the message's property to the given value. Args: prop: Name of the property to be set. info: Value to be assigned to that property. add_to_output: Decides whether to add `prop` to the `output_properties`. N)rrr#)r$r3r4r5r%r%r&r"Gs z Message.set)rcCs|j||S)N)rr+)r$r3defaultr%r%r&r+Ssz Message.getcCs<|}|tdr ||t<|td|td|S)zFGet dict representation of message as it would appear in training dataN)as_dictr+r get_full_intentpopr r )r$dr%r%r& as_dict_nluVs     zMessage.as_dict_nlucs6|rfddjD}nj}dd|DS)Ncs i|]\}}|jkr||qSr%)r).0keyvalue)r$r%r& bsz#Message.as_dict..cSsi|]\}}|dk r||qS)Nr%)r<r=r>r%r%r&r?ls)ritems)r$Zonly_output_propertiesr:r%)r$r&r7`s  zMessage.as_dictcCs"t|tsdS||kSdS)NF) isinstancer fingerprint)r$otherr%r%r&__eq__ns zMessage.__eq__cCst|dS)z]Calculate a hash for the message. Returns: Hash of the message. )intrB)r$r%r%r&__hash__tszMessage.__hash__cCstjjj|jS)zrCalculate a string fingerprint for the message. Returns: Fingerprint of the message. )r,r-r.r/Zdeep_container_fingerprintr)r$r%r%r&rB|szMessage.fingerprint)textintententitiesintent_metadataexample_metadatarrc Ksvt|i}|r2||\}} |r&||t<| r2||t<|r>||t<|dk rRt|i|t<|dk rj||tit<||f|S)aBuilds a Message from `UserUttered` data. Args: text: text of a user's utterance intent: an intent of the user utterance entities: entities in the user's utterance intent_metadata: optional metadata for the intent example_metadata: optional metadata for the intent example Returns: Message N) r separate_intent_response_keyr r rrrr1r) clsrHrIrJrKrLrrZ split_intentZ response_keyr%r%r&builds z Message.buildcCs|tr|tS|tS)z)Get intent as it appears in training data)r+r r )r$r%r%r&r8szMessage.get_full_intentcCstjjjjdtd|S)z)Get intent as it appears in training dataz~`get_combined_intent_response_key` is deprecated and will be removed in future versions. Please use `get_full_intent` instead.)category)r,r-r.r/r0DeprecationWarningr8)r$r%r%r& get_combined_intent_response_keys z(Message.get_combined_intent_response_key)original_intentrcCsX|t}t|dkr&|d|dfSt|dkr>|ddfStd|dtddS)Nrz Intent name 'z/' is invalid, it cannot contain more than one 'z'.)splitrlenr )rSZ split_titler%r%r&rMs    z$Message.separate_intent_response_key) attribute featurizersrcCs<|dkr g}|||\}}|||}|||}||fS)aGGets all sparse features for the attribute given the list of featurizers. If no featurizers are provided, all available features will be considered. Args: attribute: message attribute featurizers: names of featurizers to consider Returns: Sparse features. N)_filter_sparse_features_combine_features)r$rXrYsequence_featuressentence_featuresr%r%r&get_sparse_featuress   zMessage.get_sparse_featurescCs<|dkr g}|||\}}|||}|||}||fS)aEGets all dense features for the attribute given the list of featurizers. If no featurizers are provided, all available features will be considered. Args: attribute: message attribute featurizers: names of featurizers to consider Returns: Dense features. N)_filter_dense_featuresr[)r$rXrYr\r]r%r%r&get_dense_featuress   zMessage.get_dense_featurescCs*|||}|||}dd||DS)a9Gets all features for the attribute given the list of featurizers. If no featurizers are provided, all available features will be considered. Args: attribute: message attribute featurizers: names of featurizers to consider Returns: Features. cSsg|]}|dk r|qS)Nr%)r<fr%r%r& sz,Message.get_all_features..)r^r`)r$rXrYZsparse_featuresZdense_featuresr%r%r&get_all_featuress  zMessage.get_all_featurescCs\|dkr g}|||\}}|||\}}t|dkpZt|dkpZt|dkpZt|dkS)arChecks if there are any features present for the attribute and featurizers. If no featurizers are provided, all available features will be considered. Args: attribute: Message attribute. featurizers: Names of featurizers to consider. Returns: ``True``, if features are present, ``False`` otherwise. Nr)rZr_rW)r$rXrYZsequence_sparse_featuresZsentence_sparse_featuresZsequence_dense_featuresZsentence_dense_featuresr%r%r&features_presents    zMessage.features_presentcs4fdd|jD}fdd|jD}||fS)Ncs:g|]2}|jkr|r|jtkr|jks2s|qSr%)rXis_densetyperr*)r<ra)rXrYr%r&rb;s   z2Message._filter_dense_features..cs:g|]2}|jkr|r|jtkr|jks2s|qSr%)rXrerfrr*)r<ra)rXrYr%r&rbCs   )r)r$rXrYr]r\r%)rXrYr&r_7s     zMessage._filter_dense_featurescs4fdd|jD}fdd|jD}||fS)Ncs:g|]2}|jkr|r|jtkr|jks2s|qSr%)rX is_sparserfrr*)r<ra)rXrYr%r&rbPs   z3Message._filter_sparse_features..cs:g|]2}|jkr|r|jtkr|jks2s|qSr%)rXrgrfrr*)r<ra)rXrYr%r&rbXs   )r)r$rXrYr]r\r%)rXrYr&rZLs     zMessage._filter_sparse_features)rrYrcCs:d}x0|D](}|dkr(t|}||_q ||q W|S)N)r deepcopyr*Zcombine_with_features)rrYZcombined_featuresrar%r%r&r[bs  zMessage._combine_featurescCsht|jtpd|jtpd|jts2|jtr@|jt pd|jtod|jtpb|jt S)aChecks whether the message is a core message or from the domain. E.g. a core message is created from a story or a domain action, not from the NLU data. Returns: True, if message is a core or domain message, false otherwise. )boolrr+rrr r r )r$r%r%r&is_core_or_domain_messageqs    z!Message.is_core_or_domain_messagecCs0t|tr|t p,|to,|t S)zChecks whether the message came from an e2e story. Returns: `True`, if message is a from an e2e story, `False` otherwise. )rir+rrr r )r$r%r%r&is_e2e_messageszMessage.is_e2e_message)NNNN)F)N)F)NNNN)N)N)N)N)N)&__name__ __module__ __qualname__rrrrrrr'r)r2rir"r+dictr;r7rDrFrGrB classmethodrOr8rR staticmethodrrMr^r`rcrdr_rZr[rjrkr%r%r%r&rsX&   (   r)"jsontypingrrrrrrrr Zrasa.shared.utils.ior,Zrasa.shared.exceptionsr Zrasa.shared.nlu.constantsr r r r rrrrrrrrrZrasa.shared.constantsr TYPE_CHECKINGZ&rasa.shared.nlu.training_data.featuresrrr%r%r%r&s$ <