o i@sLddlmZddlmZddlmZddlmZeeZ GdddeZ dS)) getLogger)Fusion) NumpyHelper) OnnxModelcsFeZdZdeffdd ZfddZddZdd Zd d ZZ S) FusionConstantFoldmodelcst|ddgd|_dS)N Transposer)super__init__count)selfr __class__g/home/kim/smarthome/.venv/lib/python3.10/site-packages/onnxruntime/transformers/fusion_constant_fold.pyr s zFusionConstantFold.__init__cs.t|jdkrtd|jdSdS)NrzConstant Folded: )r applyr loggerinfo)r rrrrs  zFusionConstantFold.applycCs ||||||||dS)zX Apply multiple fusions on Transpose nodes that can be constant folded. N)fuse_1fuse_2)r nodeinput_name_to_nodesoutput_name_to_noderrrfuseszFusionConstantFold.fusecCst|jdkst|jdkrtddS|j|jd}|dur)tddSd}||jdD]}|jdkr@t|jdksDd}nq2|rNtd dS||jdD]}|jd kse|jd ksed}nqU|rotd dSt |}t|j d krtddS|j }|j } | ||j|| |j d|j dg|jd||jdD]H}tt|jD]>} |j| |jdkr|jd|j| <|jd kr| dks| dkr| dkrdnd} t|jD]\} } | j | krd|j| _qqq|j||jd7_dS)z Constant fold any initializer data representing a MatMul's weights that are stored in a Transpose op Ex: Transpose --> Gemm or Transpose --> MatMul :fuse_constant_fold: node has more than one input or outputNrz8fuse_constant_fold: failed to identify initializer inputFr TzAfuse_constant_fold: other non-Transpose nodes use the initializerZGemmZMatMulzOfuse_constant_fold: other non-Gemm and non-MatMul nodes use the transposed dataz7fuse_constant_fold: shape of initializer data is not 2D)name data_typedimsvalsZtransAZtransB)leninputoutputrdebugrZget_initializerZop_typerZto_arrayshaperrZremove_initializerZadd_initializerTrange enumerate attributeinodes_to_removeappendr )r rrrprotoskip child_nodeweightrZdtyper+keyjZattr_keyrrrr sd           zFusionConstantFold.fuse_1c Cs t|jdkst|jdkrtddS|j|dd}|dur(tddSt|jdks6t|jdkr=tddS|jdj}|jdj}||krTtddS|jd}||jd}|D]} t | jD]\} } | |jdkry|| j| <qiqb|j ||j ||j d7_ dS) z Constant fold any Transpose --> Transpose ops since the root input is the final result Ex: root_input --> Transpose --> Transpose --> next_node to root_input --> next_node rrNr rzs