o h@stdZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z m Z mZmZddlmZGd d d e ZdS) z& Image/Text processor class for FLAVA N)ListOptionalUnion) ImageInput)ProcessorMixin) BatchEncodingPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypec(s2eZdZdZddgZdZdZd*fdd Z         d+d ee d ee e e e e e e fdede eeefde eeefdeededeedeedeedeedeededededededee eeff$ddZd d!Zd"d#Zed$d%Zed&d'Zed(d)ZZS),FlavaProcessora Constructs a FLAVA processor which wraps a FLAVA image processor and a FLAVA tokenizer into a single processor. [`FlavaProcessor`] offers all the functionalities of [`FlavaImageProcessor`] and [`BertTokenizerFast`]. See the [`~FlavaProcessor.__call__`] and [`~FlavaProcessor.decode`] for more information. Args: image_processor ([`FlavaImageProcessor`], *optional*): The image processor is a required input. tokenizer ([`BertTokenizerFast`], *optional*): The tokenizer is a required input. image_processor tokenizerFlavaImageProcessor) BertTokenizerBertTokenizerFastNc sld}d|vrtdt|d}|dur|n|}|dur!td|dur)tdt|||j|_dS)Nfeature_extractorzhThe `feature_extractor` argument is deprecated and will be removed in v5, use `image_processor` instead.z)You need to specify an `image_processor`.z"You need to specify a `tokenizer`.) warningswarn FutureWarningpop ValueErrorsuper__init__rcurrent_processor)selfrrkwargsr __class__`/var/www/html/ai/venv/lib/python3.10/site-packages/transformers/models/flava/processing_flava.pyr,s  zFlavaProcessor.__init__TFrimagestextadd_special_tokenspadding truncation max_lengthstridepad_to_multiple_ofreturn_image_maskreturn_codebook_pixelsreturn_token_type_idsreturn_attention_maskreturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverbosereturn_tensorscKs|dur |dur td|dur(|jd|||||||| | | |||||d|}|dur9|j|f| | |d|}|durH|durH|||S|durN|Sttdi||dS)a  This method uses [`FlavaImageProcessor.__call__`] method to prepare image(s) for the model, and [`BertTokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. Nz?You have to specify either text or images. Both cannot be none.)r$r%r&r'r(r)r*r-r.r/r0r1r2r3r4)r+r,r4)data tensor_typer!)rrrupdaterdict)rr#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4rencodingimage_featuresr!r!r"__call__?sL zFlavaProcessor.__call__cO|jj|i|S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r batch_decoderargsrr!r!r"r=zFlavaProcessor.batch_decodecOr<)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rdecoder>r!r!r"rAr@zFlavaProcessor.decodecCs"|jj}|jj}tt||S)N)rmodel_input_namesrlistr8fromkeys)rtokenizer_input_namesimage_processor_input_namesr!r!r"rBsz FlavaProcessor.model_input_namescCtdt|jS)Nzg`feature_extractor_class` is deprecated and will be removed in v5. Use `image_processor_class` instead.)rrrimage_processor_classrr!r!r"feature_extractor_class z&FlavaProcessor.feature_extractor_classcCrG)Nz[`feature_extractor` is deprecated and will be removed in v5. Use `image_processor` instead.)rrrrrIr!r!r"rrKz FlavaProcessor.feature_extractor)NN)NNTFFNrNNNNNFFFFTN)__name__ __module__ __qualname____doc__ attributesrHtokenizer_classrrrrr r rboolstrr r intr r;r=rApropertyrBrJr __classcell__r!r!rr"rs         D  r)rOrtypingrrr image_utilsrprocessing_utilsrtokenization_utils_baserr r r r utilsr rr!r!r!r"s