ijoBJdZddlZddlZddlZddlZddlZddlmZmZm Z m Z ddl Z ddl m Zddl mZddlmZdZdZd Zd Zd Zdd Zd ZdZdZd dZdZdZdZdZdZ dZ!dZ"dZ#dZ$e dZ%de ejLejNfdee%dee%fdZ(y)!zUtility functions for FlatBuffers. All functions that are commonly used to work with FlatBuffers. Refer to the tensorflow lite flatbuffer schema here: tensorflow/lite/schema/schema.fbs N)OptionalTypeTypeVarUnion)schema_py_generated) schema_util)gfilesTFL3ctjj|d}tjj |S)zBConverts a tflite model from a bytearray to an object for parsing.r) schema_fbModelGetRootAsModelModelT InitFromObj)model_bytearray model_objects {/var/www/html/emotional.easysim.app/public_html/venv/lib/python3.12/site-packages/tensorflow/lite/tools/flatbuffer_utils.pyconvert_bytearray_to_objectr's///C,    % %l 33ctj|std|ztj|d5}t |j }dddt |S#1swYt SxYw)a2Reads a tflite model as a python object. Args: input_tflite_file: Full path name to the input tflite file Raises: RuntimeError: If input_tflite_file path is invalid. IOError: If input_tflite_file cannot be opened. Returns: A python object corresponding to the input tflite file. zInput file not found at %r rbN)r Exists RuntimeErrorGFile bytearrayreadread_model_from_bytearray)input_tflite_fileinput_file_handlers r read_modelr-so ' ( 58II JJ {{$d+:/@ 1 6 6 89O: "? 33: "? 33s A''A:ct|}tjdk(r t|dd|jD]H}|j s||j |j |j z|_d|_d|_J|jD]Y}|jD]H}|js||j|j|jz|_ d|_ d|_ J[|S)zReads a tflite model as a python object. Args: model_bytearray: TFLite model in bytearray format. Returns: A python object corresponding to the input tflite file. biglittler) rsys byteorderbyte_swap_tflite_model_objbuffersoffsetsizedata subgraphs operatorslargeCustomOptionsOffsetlargeCustomOptionsSize customOptions)rmodelbuffersubgraphops rrrAs &o 6%]]euh6 f }}#FMMFMMFKK4OPfkfmfk  //&h  & $ $*  ' '"*E*E''+( '(#$%!&& ,rc>tjt|S)aCReads a tflite model as a python object with mutable tensors. Similar to read_model() with the addition that the returned object has mutable tensors (read_model() returns an object with immutable tensors). NOTE: This API only works for TFLite generated with _experimental_use_buffer_offset=false Args: input_tflite_file: Full path name to the input tflite file Raises: RuntimeError: If input_tflite_file path is invalid. IOError: If input_tflite_file cannot be opened. Returns: A mutable python object corresponding to the input tflite file. )copydeepcopyr)rs rread_model_with_mutable_tensorsr6as& z"34 55rctjd}|j|}|j|tt |j }||z}|S)z@Converts a tflite model from an object to a immutable bytearray.i)file_identifier) flatbuffersBuilderPackFinish_TFLITE_FILE_IDENTIFIERbytesOutput)r extra_bufferbuilder model_offsetrs rconvert_object_to_bytearrayrCwsV    %'""7+, ../F.G'..*+/#l2/ rctjdk(r"tj|}t |ddt |}t j|d5}|j|dddy#1swYyxYw)asWrites the tflite model, a python object, into the output file. NOTE: This API only works for TFLite generated with _experimental_use_buffer_offset=false Args: model_object: A tflite model as a python object output_tflite_file: Full path name to the output tflite file. Raises: IOError: If output_tflite_file path is invalid or cannot be opened. r!r"wbN) r#r$r4r5r%rCr rwrite)routput_tflite_fileroutput_file_handles r write_modelrIsi ]]e==.L|UH=/ =/ {{%t,.0B_-...s A22A;cd|_|jD]!}d|_|jD] }d|_ #d|_y)ayStrips all nonessential strings from the model to reduce model size. We remove the following strings: (find strings by searching ":string" in the tensorflow lite flatbuffer schema) 1. Model description 2. SubGraph name 3. Tensor names We retain OperatorCode custom_code and Metadata name. Args: model: The model from which to remove nonessential strings. N) descriptionr*nametensors signatureDefs)r/r1tensors r strip_stringsrPsL%//hHM""fk %rcvtjjjD]\}}||k(s |cSy)z4Converts a numerical enum to a readable tensor type.N)r TensorType__dict__items) tensor_typerLvalues r type_to_namerWs<))2288:kdE  k rc8tj||j}tdt |}||Dcgc] }||vs| }}i}|j D]c}|j D]R}|j |jD]3} |j| } t| j|| j<5Te|D]} || j} | dn | j} | dk(r(|j| d}|jdr]|dk(rdnd}td| t!j"|D]0}tj$d d }t!j&|| ||2t| D]}tj(dd | |<ycc}w) aRandomize weights in a model. Args: model: The model in which to randomize weights. random_seed: The input to the random number generator (default value is 0). buffers_to_skip: The list of buffer indices to skip. The weights in these buffers are left unmodified. NrINT8FLOATFLOAT16efgg?)randomseedr&rangelenr*r+inputsrMrWtyper0r)r(get startswithstructcalcsizeuniform pack_intorandint)r/ random_seedbuffers_to_skipr& buffer_idsidx buffer_typesgraphr2 input_idxrOi buffer_i_data buffer_i_size buffer_type format_coder'rVjs rrandomize_weightsrzs ++k MM'QG %* !+J#s//I#JJJ,@eoo@   yy@)y)&26;;&? V]]#@@@ 2aAJOOM&.AM4F4FM""1f-Kg&&)3Ck!]FOOK,HID&tS)mVUCD]#2!!>>!S1 a2'2Ks FFc|jD]H}|js|jjd}||vs0||jd|_Jy)zRename custom ops so they use the same naming style as builtin ops. Args: model: The input tflite model. map_custom_op_renames: A mapping from old to new custom op names. asciiN) operatorCodes customCodedecodeencode)r/map_custom_op_renamesop_code op_code_strs rrename_custom_opsrs[$$Pg&&--g6k - -2;?FFwO Prc|j|}t|j|j}t t j jD]\}}||k(s |cSy)zConverts a TFLite op_code to the human readable name. Args: model: The input tflite model. op_code: The op_code to resolve to a readable name. Returns: A string containing the human readable op name, or None if not resolvable. N)r}max builtinCodedeprecatedBuiltinCodevarsr BuiltinOperatorrT)r/rr2coderLrVs ropcode_to_namersb 7#" R^^R55 6$)334::<kdE } k rc tjd}t}t|5}|D]m}|j |}||j d}t d|jd}|Dcgc]}t|d} }|j| o dddt|Scc}w#1swYt|SxYw)a@Converts xxd output C++ source file to bytes (immutable). Args: input_cc_file: Full path name to th C++ source file dumped by xxd Raises: RuntimeError: If input_cc_file path is invalid. IOError: If input_cc_file cannot be opened. Returns: A bytearray corresponding to the input cc file array. z\W*(0x[0-9a-fA-F,x ]+).*NrY,)base) recompileropenmatchgroupfiltersplitintextendr>) input_cc_filepatternr file_handleline values_match list_text values_textxvaluess rxxd_output_to_bytesr s JJ2 3'K/ M%k%]]4(l  $$Q'i4!56k*55AAB5f5V$%%$  6%$  sA B75B2 B72B77C c.t|}t|S)a7Converts xxd output C++ source file to object. Args: input_cc_file: Full path name to th C++ source file dumped by xxd Raises: RuntimeError: If input_cc_file path is invalid. IOError: If input_cc_file cannot be opened. Returns: A python object corresponding to the input tflite file. )rr)r model_bytess rxxd_output_to_objectr0s$M2+ $[ 11rc "tdt|j|Dcgc]}|j|||z}}dj|Dcgc](}tj ||j ||*c}|_ycc}wcc}w)z4Helper function for byte-swapping the buffers field.rrN)rbrcr)joinr from_bytesto_bytes)r0 chunksize from_endiness to_endinessrtto_swapbyteswaps rbyte_swap_buffer_contentrAsQFKK()4   kk!a)m$ '   nnX}-66y+N&+  s B -B c rtj|jdd|}t|jd|dzzd}dj t d|dzdzdzdDcgc]8}tj|j||dz|j d|:c}}||z|_ycc}w)aHelper function for byte-swapping the string buffer. Args: buffer: TFLite string buffer of from_endiness format. from_endiness: The original endianness format of the string buffer. to_endiness: The destined endianness format of the string buffer. rNrrY)rrr)rrrbr)r0rrnum_of_stringsstring_contentrt prefix_datas rbyte_swap_string_contentrMs>>&++a"2MB.V[[nq.@)A)CDE.Q!+q014a8   nnV[[QU+];DD [+ n,&+ s%=B4cb|yg}tjjtjjtjjg}tjj tjj tjjtjjg}tjjtjjtjjtjjg}|jD]}|jD]n}|jdkDs|jt!|j"ks7|j|vsF|j"|jj$j|j&tjj(k(r%t+|j"|j||n|j&|vr&t-|j"|jd||nj|j&|vr&t-|j"|jd||n6|j&|vr&t-|j"|jd||nT|j/|jqy)aByte swaps the buffers field in a TFLite model. Args: model: TFLite model object of from_endiness format. from_endiness: The original endianness format of the buffers in model. to_endiness: The destined endianness format of the buffers in model. Nrrr)r rRr\INT16UINT16FLOAT32INT32 COMPLEX64UINT32INT64FLOAT64 COMPLEX128UINT64r*rMr0rcr&r)reSTRINGrrappend) r/rrbuffer_swappedtypes_of_16_bitstypes_of_32_bitstypes_of_64_bitsr1rOs rr%r%`s ] .""  !! ""  $$!!   ""%%!!  //-h""- --! mmc%--00mm>1mmFMM*//; ;;)..55 5 "mmFMM*M; [[, , "mmFMM*A}k [[, , "mmFMM*A}k [[, , "mmFMM*A}k  fmm,3--rcN|yt|}t|||t|S)aGenerates a new model byte array after byte swapping its buffers field. Args: tflite_model: TFLite flatbuffer in a byte array. from_endiness: The original endianness format of the buffers in tflite_model. to_endiness: The destined endianness format of the buffers in tflite_model. Returns: TFLite flatbuffer in a byte array, after being byte swapped to to_endiness format. N)rr%rC) tflite_modelrrr/s rbyte_swap_tflite_bufferrs2  %l 3%UM;? %U ++rct|tjs t|}t }|j D]}|j |j D]q}tj|j|j}|tjjk(sM|j|jjst!|S)zCalculates the number of unique resource variables in a model. Args: model: the input tflite model, either as bytearray or object. Returns: An integer number representing the number of unique resource variables. ) isinstancer rrsetr*r+r#get_builtin_code_from_operator_coder} opcodeIndexr VAR_HANDLEaddbuiltinOptions sharedNamerc)r/unique_shared_namesr1r2 builtin_codes rcount_resource_variablesrs E9++ , ' .E//>h!  > DD   bnn -l 22== = 1 1 < <= >> !!rOptsTr2 opts_typereturnctd|}|j}|jds||jd}t t j |}|st t j|s|t|t jr|sKtt j|}t j}|j}|j} nJtt j |}t j}|j }|j} || |k7ry|||St|t jr,|r |j } n |j"} | t| |sy| Sy)aGet the options of an operator as the specified type. Requested type must be an object-api type (ends in 'T'). Args: op: The operator to get the options from. opts_type: The type of the options to get. Returns: The options as the specified type, or None if the options are not of the specified type. Raises: ValueError: If the specified type is not a valid options type. zUnsupported options type: TN) ValueError__name__endswith removesuffixhasattrr BuiltinOptionsBuiltinOptions2rOperatorgetattrBuiltinOptions2CreatorBuiltinOptions2TypeBuiltinOptionsCreatorBuiltinOptionsType OperatorTrbuiltinOptions2) r2rerr type_namebase_type_name is_opt_1_typeenum_val opts_creatorraw_opsactual_enum_val raw_ops_ts rget_options_asrsY& / {;<#%%)   C I))#..)22NC- w  II&&' 22NCh55l""$g..0o11>Bh44l!!#g--/o/X5  ' **"i))*##i$$i 9i @   r)r)rN))__doc__r4r`rrhr#typingrrrrr9tensorflow.lite.pythonrr rtensorflow.python.platformr r=rrrr6rCrIrPrWrzrrrrrrr%rrrrrrrrrs 11C.,!4 4(@6,.*.02f P$$ N2" -&7-t,2"0 7 i  )"5"5567CG;7 e_7r