o ¢ÄiHã@sLddlmZddlmZddlmZddlmZeeƒZ Gdd„deƒZ dS)é)Ú getLogger)ÚFusionAttentionClip)Ú ModelProto)Ú BertOnnxModelcs<eZdZd dededef‡fdd„ Zdd„Zd d „Z‡ZS) Ú ClipOnnxModelrÚmodelÚ num_headsÚ hidden_sizecs(tƒj|||dt||j|jƒ|_dS)N)rr )ÚsuperÚ__init__rr rÚclip_attention_fusion)Úselfrrr ©Ú __class__©úb/home/kim/smarthome/.venv/lib/python3.10/site-packages/onnxruntime/transformers/onnx_model_clip.pyr szClipOnnxModel.__init__cCs@i}gd¢}|D] }| |¡}t|ƒ||<qt d|›¡|S)z8 Returns node count of fused operators. )Z AttentionZFastGeluZGeluZLayerNormalizationZ QuickGeluZBiasGeluZSkipLayerNormalizationzOptimized operators:)Zget_nodes_by_op_typeÚlenÚloggerÚinfo)r Zop_countÚopsÚopÚnodesrrrÚget_fused_operator_statisticss z+ClipOnnxModel.get_fused_operator_statisticscCs|j ¡dS)N)r Úapply)r rrrÚfuse_attention)szClipOnnxModel.fuse_attention)rr) Ú__name__Ú __module__Ú __qualname__rÚintr rrÚ __classcell__rrrrrsrN) ÚloggingrZfusion_attention_cliprZonnxrZonnx_model_bertrrrrrrrrÚs