o óÜÓh0ã@s`dZddlmZmZmZddlmZddlmZm Z m Z m Z m Z ddl mZGdd„deƒZd S) z! Processor class for Pix2Struct. é)ÚListÚOptionalÚUnioné)ÚProcessorMixin)Ú BatchEncodingÚPaddingStrategyÚPreTokenizedInputÚ TextInputÚTruncationStrategy)Ú TensorTypec$seZdZdZddgZdZdZ‡fdd„Z       d&d ee e e e e e fde dee e efdee e efdeedeededeedee de de de de de de deee efdef"dd„Zd d!„Zd"d#„Zed$d%„ƒZ‡ZS)'ÚPix2StructProcessora´ Constructs a PIX2STRUCT processor which wraps a BERT tokenizer and PIX2STRUCT image processor into a single processor. [`Pix2StructProcessor`] offers all the functionalities of [`Pix2StructImageProcessor`] and [`T5TokenizerFast`]. See the docstring of [`~Pix2StructProcessor.__call__`] and [`~Pix2StructProcessor.decode`] for more information. Args: image_processor (`Pix2StructImageProcessor`): An instance of [`Pix2StructImageProcessor`]. The image processor is a required input. tokenizer (Union[`T5TokenizerFast`, `T5Tokenizer`]): An instance of ['T5TokenizerFast`] or ['T5Tokenizer`]. The tokenizer is a required input. Úimage_processorÚ tokenizerÚPix2StructImageProcessor)Ú T5TokenizerÚT5TokenizerFastcsd|_tƒ ||¡dS)NF)Úreturn_token_type_idsÚsuperÚ__init__)Úselfrr©Ú __class__©új/var/www/html/ai/venv/lib/python3.10/site-packages/transformers/models/pix2struct/processing_pix2struct.pyr-szPix2StructProcessor.__init__NTFérÚtextÚadd_special_tokensÚpaddingÚ truncationÚ max_lengthÚ max_patchesÚstrideÚpad_to_multiple_ofÚreturn_attention_maskÚreturn_overflowing_tokensÚreturn_special_tokens_maskÚreturn_offsets_mappingrÚ return_lengthÚverboseÚreturn_tensorsÚreturncKs(|dur |dur tdƒ‚|dur2|jjs2|j|_|jd ||||||| | | | | ||||dœ|¤Ž}|S|jjsC|j|f||dœ|¤Ž}n |j|f|||dœ|¤Ž}|dur‡|jjs‡|jd ||||||| | | | | ||||dœ|¤Ž}d|vr{| d¡|d<d|vr†| d¡|d <nd}|dur’| |¡|S) a This method uses [`Pix2StructImageProcessor.preprocess`] method to prepare image(s) for the model, and [`T5TokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. Nz*You have to specify either images or text.)rrrrr r"r#r$r%r&r'rr(r)r*)r*r!)r*r!Ú header_textÚattention_maskÚdecoder_attention_maskÚ input_idsÚdecoder_input_idsr)Ú ValueErrorrÚis_vqarÚcurrent_processorÚpopÚupdate)rÚimagesrrrrr r!r"r#r$r%r&r'rr(r)r*ÚkwargsÚ text_encodingÚencoding_image_processorrrrÚ__call__1sˆñðÿÿÿÿÿÿñð€ zPix2StructProcessor.__call__cOó|jj|i|¤ŽS)zÇ This method forwards all its arguments to Pix2StructTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )rÚ batch_decode©rÚargsr7rrrr<‘óz Pix2StructProcessor.batch_decodecOr;)zÁ This method forwards all its arguments to Pix2StructTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rÚdecoder=rrrr@˜r?zPix2StructProcessor.decodecCs"|jj}|jj}tt ||¡ƒS)N)rÚmodel_input_namesrÚlistÚdictÚfromkeys)rÚtokenizer_input_namesÚimage_processor_input_namesrrrrAŸsz%Pix2StructProcessor.model_input_names)NNTFNNrrNNFFFFFTN)Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú attributesÚimage_processor_classÚtokenizer_classrrr r rÚboolÚstrrr rÚintr rr:r<r@ÚpropertyrAÚ __classcell__rrrrr s| îýü û úùø ÷ ö õ ô óòñðïî ì`r N)rJÚtypingrrrÚprocessing_utilsrÚtokenization_utils_baserrr r r Úutilsr r rrrrÚs