B )`WD@sdZddlmZddlmZddlmZddlZddlZddlZddl m Z ddl m Z ddl mZdd l mZdd l mZdd l mZdd l mZdd l mZddl mZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z dDddZddZ!ddZ"dEddZ#ddZ$d d!Z%dFd#d$Z&Gd%d&d&e'Z(dGd(d)Z)d*d+Z*d,d-Z+e,a-d.d/Z.d0d1Z/d2d3Z0d4d5Z1d6d7Z2e j3d8d9Z4e j3d:d;Z5dd?Z7d@dAZ8dBdCZ9dS)IzTensorFlow-related utilities.)absolute_import)division)print_functionN) cardinality)context)composite_tensor)ops) smart_cond) tensor_shape) tensor_spec) tensor_util) type_spec)backend)control_flow_ops)math_ops) variables)nest)object_identity) tf_contextlibcCs0t|tjrtj||||dStj||||dS)aReturn either `true_fn()` if predicate `pred` is true else `false_fn()`. If `pred` is a bool or has a constant value, we return either `true_fn()` or `false_fn()`, otherwise we use `tf.cond` to dynamically route to both. Arguments: pred: A scalar determining whether to return the result of `true_fn` or `false_fn`. true_fn: The callable to be performed if pred is true. false_fn: The callable to be performed if pred is false. name: Optional name prefix when using `tf.cond`. Returns: Tensors returned by the call to either `true_fn` or `false_fn`. Raises: TypeError: If `true_fn` or `false_fn` is not callable. )true_fnfalse_fnname) isinstancerVariablerZcond smart_moduler )predrrrrU/home/dcms/DCMS/lib/python3.7/site-packages/tensorflow/python/keras/utils/tf_utils.pyr *s  r cCs>t|tr$|dkrd}n |dkr$d}t|tjr4dSt|S)aReturn the bool value for `pred`, or None if `pred` had a dynamic value. Arguments: pred: A scalar, either a Python bool or a TensorFlow boolean variable or tensor, or the Python integer 1 or 0. Returns: True or False if `pred` has a constant boolean value, None otherwise. Raises: TypeError: If `pred` is not a Variable, Tensor or bool, or Python integer 1 or 0. TrFN)rintrrrZsmart_constant_value)rrrrconstant_valueDs  r cCs*t|}|r"t|dtjr"dSdSdS)NrTF)rflattenrrTensor)vrrris_tensor_or_tensor_list^s r$cCs*tj|dd}t|}|r,tt|}|dd}x|r$|}t|ttrXq:t|tj r|j ddptg}||j 7}nXt|t j ry |jg}Wqtk rg}YqXn$t|r|}ntdt|x:|D]2}||kr|||r|||d|qW|r:|s:|Sq:W|S)aIReturns the set of tensors/ops reachable from `inputs`. Stops if all targets have been found (target is optional). Only valid in Symbolic mode, not Eager mode. Args: inputs: List of tensors. targets: List of tensors. Returns: A set of tensors reachable from the inputs (includes the inputs themselves). T)expand_compositesNz-Expected Operation, Variable, or Tensor, got r)rr!rZObjectIdentitySetpoprtuple_user_convertible_tensor_typesrZ OperationoutputsZ_control_outputsrropAttributeErrorr is_tensorZ consumers TypeErrorstradddiscardinsert)inputstargetsZ reachableZremaining_targetsqueuexr)yrrrget_reachable_from_inputsfs:            r7csrSts(tdtrLfddtD}ntr`t}n}fdd|D}t|S)aMaps the atomic elements of a nested structure. Arguments: is_atomic_fn: A function that determines if an element of `nested` is atomic. map_fn: The function to apply to atomic elements of `nested`. nested: A nested structure. Returns: The nested structure, with atomic elements mapped according to `map_fn`. Raises: ValueError: If an element that is neither atomic nor a sequence is encountered. z0Received non-atomic and non-sequence element: {}csg|] }|qSrr).0k)nestedrr sz-map_structure_with_atomic..csg|]}t|qSr)map_structure_with_atomic)r8ele) is_atomic_fnmap_fnrrr;s) r is_sequence ValueErrorformatZ _is_mappingZ_sortedZ _is_attrs_astupleZ_sequence_like)r>r?r:valuesZ mapped_valuesr)r>r?r:rr<s     r<cCstdd|S)zGets shapes from tensors.cSs|jS)N)shape)r5rrrzget_shapes..)r map_structure)tensorsrrr get_shapessrJTcs,ddfdd}fdd}t|||S)aConverts nested shape representations to desired format. Performs: TensorShapes -> tuples if `to_tuples=True`. tuples of int or None -> TensorShapes if `to_tuples=False`. Valid objects to be converted are: - TensorShapes - tuples with elements of type int or None. - ints - None Arguments: input_shape: A nested structure of objects to be converted to TensorShapes. to_tuples: If `True`, converts all TensorShape to tuples. Otherwise converts all tuples representing shapes to TensorShapes. Returns: Nested structure of shapes in desired format. Raises: ValueError: when the input tensor shape can't be converted to tuples, eg unknown tensor shape. cSs|dkpt|ttjfS)N)rrr Z Dimension)valuerrr_is_shape_componentsz+convert_shapes.._is_shape_componentcsH|r dSt|tjrdSt|ttfrDtfdd|DrDdSdS)NTc3s|]}|VqdS)Nr)r8r=)rLrr sz;convert_shapes.._is_atomic_shape..F)rr TensorShaper'listall) input_shape)rLrr_is_atomic_shapes z(convert_shapes.._is_atomic_shapecst|}rt|}|S)N)r rNr'as_list)rQ) to_tuplesrr_convert_shapes  z&convert_shapes.._convert_shape)r<)rQrTrRrUr)rLrTrconvert_shapess  rVc@s eZdZdZddZddZdS) ListWrapperz9A wrapper for lists to be treated as elements for `nest`.cCs ||_dS)N)_list)selfZ list_to_wraprrr__init__szListWrapper.__init__cCs|jS)N)rX)rYrrrrSszListWrapper.as_listN)__name__ __module__ __qualname____doc__rZrSrrrrrWsrWFcs.ddfdd}fdd}t|||S)aQEither wraps or unwraps innermost node data lists in `ListWrapper` objects. Arguments: nested: A nested data structure. wrap: If `True`, wrap innermost lists in `ListWrapper` objects. If `False`, unwraps `ListWrapper` objects into lists. Returns: Structure of same type as nested, with lists wrapped/unwrapped. cSs.t|tr*t|dkr*t|dtjr*dSdS)N)rTF)rrOlensix string_types)r:rrr_is_serialized_node_datasz9convert_inner_node_data.._is_serialized_node_datacs&t|trdS|rdSt| S)z._is_atomic_nestedcs@r&t|tr|S|r"t|S|St|tr8|S|SdS)z:Convert b/t `ListWrapper` object and list representations.N)rrWrS)r:)rdwraprr_convert_object_or_list!s  z8convert_inner_node_data.._convert_object_or_list)r<)r:rfrergr)rdrfrconvert_inner_node_datas   rhcsfdd}|S)zDecorator that handles tuple/TensorShape conversion. Used in `compute_output_shape` and `build`. Arguments: fn: function to wrap. Returns: Wrapped function. cs6|dk rt|dd}||}|dk r2t|dd}|S)NT)rTF)rV)instancerQZ output_shape)fnrrwrapper>s    z&shape_type_conversion..wrapperr)rjrkr)rjrshape_type_conversion2s rlcCsttt|S)N)rPmapis_symbolic_tensor)rIrrrare_all_symbolic_tensorsLsrocCst|tjrt|dSt|tjrBtj|dd}tdd|DSt|t j rdt |ddpbt St|ttrt|}t|SdSdS) aNReturns whether a tensor is symbolic (from a TF graph) or an eager tensor. A Variable can be seen as either: it is considered symbolic when we are in a graph scope, and eager when we are in an eager scope. Arguments: tensor: A tensor instance to test. Returns: True for symbolic tensors, False for eager tensors. graphT)r%css|]}t|dVqdS)rpN)hasattr)r8trrrrMcsz%is_symbolic_tensor.._keras_historyFN)rrr"rqrCompositeTensorrr!anyrrgetattrrZexecuting_eagerlyr'r(Zconvert_to_tensor_or_compositern)ZtensorZcomponent_tensorsrrrrnSs       rncCst|dS)aAllows users to specify types regarded as symbolic `Tensor`s. Used in conjunction with `tf.register_tensor_conversion_function`, calling `tf.keras.utils.register_symbolic_tensor_type(cls)` allows non-`Tensor` objects to be plumbed through Keras layers. Example: ```python # One-time setup. class Foo(object): def __init__(self, input_): self._input = input_ def value(self): return tf.constant(42.) tf.register_tensor_conversion_function( Foo, lambda x, *args, **kwargs: x.value()) tf.keras.utils.register_symbolic_tensor_type(Foo) # User-land. layer = tf.keras.layers.Lambda(lambda input_: Foo(input_)) ``` Arguments: cls: A `class` type which shall be regarded as a symbolic `Tensor`. N)r(r/)clsrrrregister_symbolic_tensor_typessrxcCsDt|tjr|jSt|dr6t|dr6t|j|jSt |SdS)z9Grab type_spec without converting array-likes to tensors.rEdtypeN) rrrt _type_specrqr TensorSpecrEryr type_spec_from_value)rKrrrr|s  r|cCst|pt|tjS)N)r r,rrr)r5rrris_tensor_or_variablesr}cCs8dd|D}|r4ddd|D}td|dS)aHPrevent tf.layers.Layers from being used with Keras. Certain legacy layers inherit from their keras analogs; however they are not supported with keras and can lead to subtle and hard to diagnose bugs. Args: layers: A list of layers to check Raises: TypeError: If any elements of layers are tf.layers.Layers cSsg|]}t|ddr|qS)Z_is_legacy_layerN)rv)r8lrrrr;sz+assert_no_legacy_layers.. css|]}dt|VqdS)z N)r.)r8r~rrrrMsz*assert_no_legacy_layers..aThe following are legacy tf.layers.Layers: {} To use keras as a framework (for instance using the Network, Model, or Sequential classes), please use the tf.keras.layers implementation instead. (Or, if writing custom layers, subclass from tf.keras.layers rather than tf.layers)N)joinr-rB)ZlayersZ legacy_layersZ layer_strrrrassert_no_legacy_layerss rc cs:tr0t|ddr0t dVWdQRXndVdS)zOpen an `init_scope` if in V2 mode and using the keras graph. Arguments: layer: The Layer/Model that is currently active. Yields: None Z _keras_styleTN)r#executing_eagerly_outside_functionsrvZ init_scope)Zlayerrrrmaybe_init_scopes   rc osLtddt|t|DrBt dVWdQRXndVdS)zHReturns graph context manager if any of the inputs is a symbolic tensor.css|]}t|VqdS)N)rn)r8r#rrrrMsz5graph_context_for_symbolic_tensors..N)rurOrDKZ get_graphZ as_default)argskwargsrrr"graph_context_for_symbolic_tensorss"rcCs>trtt|tjStt|}|tjkSdS)z'True if the passed dataset is infinite.N) rrrequalrZINFINITErZ get_sessionrun)ZdatasetZ dataset_sizerrrdataset_is_infinites rcCst|tjr|}nht|tjr&|j}nTt|drLt|jddrL|jdjSt|drvt|drvtj |j |j |d}ndS|s|St |}|j}|rd|d<t||_|S)z?Returns a `TensorSpec` given a single `Tensor` or `TensorSpec`.rsrrzrEry)rEryrN)rr ZTypeSpecrrtrzrqrsr r{rErycopydeepcopyZ_shaperSr rN)rrZ dynamic_batchrspecZdynamic_batch_specrErrrget_tensor_specs$       rcCsdd}t||S)a{Converts a structure of `Tensor`s to `NumPy` arrays or Python scalar types. For each tensor, it calls `tensor.numpy()`. If the result is a scalar value, it converts it to a Python type, such as a float or int, by calling `result.item()`. Numpy scalars are converted, as Python types are often more convenient to deal with. This is especially useful for bfloat16 Numpy scalars, which don't support as many operations as other Numpy values. Args: tensors: A structure of tensors. Returns: `tensors`, but scalar tensors are converted to Python types and non-scalar tensors are converted to Numpy arrays. cSs2t|tjr.|}t|dkr*|S|S|S)Nr)rrr"numpynpndimitem)rrr5rrr_to_single_numpy_or_python_types z@to_numpy_or_python_type.._to_single_numpy_or_python_type)rrH)rIrrrrto_numpy_or_python_typesrcCsTt|}t|dd}|dkr(td|g}x|D]}|t||jq2Wt|S)z2Converts the given attrs to tuple non-recursively.Z__attrs_attrs__Nz#%r is not an attrs-decorated class.)typervrAappendrr')attrsrwfieldsrDfieldrrrrCs   rC)NNN)N)T)F)FN):r^ __future__rrrrrrrbZ'tensorflow.python.data.experimental.opsrZtensorflow.python.eagerrZtensorflow.python.frameworkrrr rr r r r Ztensorflow.python.kerasrrZtensorflow.python.opsrrrZtensorflow.python.utilrrrr r$r7r<rJrVobjectrWrhrlrosetr(rnrxr|r}rcontextmanagerrrrrrrCrrrrsZ                     7# 3 - !