o i@sXddlZddlZddlZddlmZmZeeZGdddej j Z GdddZ dS)N) MT5ConfigT5Configcs2eZdZdZdeeBffdd ZddZZS) T5Encoderz-T5 encoder outputs only the last hidden stateconfigcst||_||_dSN)super__init__encoderr)selfr r __class__g/home/kim/smarthome/.venv/lib/python3.10/site-packages/onnxruntime/transformers/models/t5/t5_encoder.pyrs  zT5Encoder.__init__cCs|||dS)Nr)r r input_idsattention_maskr r rforwardszT5Encoder.forward) __name__ __module__ __qualname____doc__rrrr __classcell__r r r rrsrc @sJeZdZddZe ddedededejdef d d Z d e fd d Z dS)T5EncoderInputscCs||_||_dSrrrrr r rrs zT5EncoderInputs.__init__F batch_sizesequence_length vocab_sizedeviceuse_int32_inputsc Cs|rtjntj}tjd|d||f||d}tj||g||d}|dkr;t|D]}td|d} d||d| f<q(t||S)aICreate dummy inputs for T5 encoder. Args: batch_size (int): batch size sequence_length (int): sequence length vocab_size (int): vocabulary size device (torch.device): device of output tensors Returns: T5EncoderInputs: dummy inputs for encoder r)lowhighsizedtyper)r#rN)torchZint32Zint64randintZonesrangerandomr) rrrrrr#rriZpadding_positionr r r create_dummy s  zT5EncoderInputs.create_dummyreturncCsdd|j|jfD}|S)NcSsg|]}|dur|qSrr ).0vr r r Esz+T5EncoderInputs.to_list..r)r Z input_listr r rto_listDszT5EncoderInputs.to_listN)F) rrrr staticmethodintr%rboolr*listr/r r r rrs  #r) loggingr(r%Z transformersrr getLoggerrloggernnModulerrr r r rs