o h= @sUdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZmZmZmZmZmZdd l m!Z!m"Z"m#Z#m$Z$d d l%m&Z&m'Z'e rydd l(m)Z)m*Z*dd l+m,Z,e-Z.ee-e fZ/ee0ee/e.de1e2fZ3ddhZ4e5e6Z7eGdddZ8Gddde0Z9ddZ:ddZ;ddZde3d#e-de-fd$d%Z?d&e-ddfd'd(Z@de0defd)d*ZAde0defd+d,ZBde0ddfd-d.ZCd/ee0efdefd0d1ZDd2ee0d3eEdeee-ee'ffd4d5ZFd2e e0d3eEdee e-e e'ffd6d7ZGd8e0d3eEdeee-e'ffd9d:ZHd;ee0dee&fdd?ZJd8e0dee&fd@dAZKdBdCd/dDde e0fdEdFZLiZMeee-ee-feNdG<dHee-dIee-ddfdJdKZOdHee-dee-fdLdMZPdNedefdOdPZQdQee-dRee-defdSdTZRdS)UzEContains utilities used by both the sync and async inference clients.N) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIODictIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager"z text-to-imagezimage-to-imagec@s\eZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<dS)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__r rrr bytesrr0r0W/var/www/html/ai/venv/lib/python3.10/site-packages/huggingface_hub/inference/_common.pyr#Es   r#cs>eZdZUdZeeed<ddedeeffdd ZZ S) MimeBytesa& A bytes object with a mime type. To be returned by `_prepare_payload_open_as_mime_bytes` in subclasses. Example: ```python >>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeNr(cs2t||}||_t|tr|dur|j|_|SN)super__new__r3 isinstancer2)clsr(r3obj __class__r0r1r6`s zMimeBytes.__new__r4) r*r+r,__doc__r r-r.r/r6 __classcell__r0r0r:r1r2Os  $r2cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r?r0r0r1_import_aiohttpkr@cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rr>numpy)rBr0r0r1 _import_numpytrArCcCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr!)rr>PILr"r!r0r0r1_import_pil_image}s  rEcontentreturncCdSr4r0rFr0r0r1_open_as_mime_bytesrJcCrHr4r0rIr0r0r1rJrKcCs|durdSt|trt|St|ttfrtt|St|drHtd|}t|dr7t |j dnd}t|t rBt dt||dSt|t r|dsW|d r}td |t|}|jd }|durvt |d}t|j|dSt|}|std |d t|trtd|t|t |ddStrddlm}t||jrtdt}|jpd}|j||dt|d|dSt dt |d)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r3https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from r!zConverting PIL Image to bytesPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r7r/r2 bytearray memoryviewhasattrloggerdebugrL mimetypes guess_typerMr- TypeError startswithrgetr)rFrexistsFileNotFoundError read_bytesrrDr"ioBytesIOrQsavegetvaluelowertype)rFr(r3responser"bufferrQr0r0r1rJsP               cCst|}t|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rJbase64 b64encodedecode)rF raw_bytesr0r0r1 _b64_encodesrkdefault_mime_typecCsHt|tr |dr |St|}|jp|}t|}d|d|S)N)rOrNdata:rmz;base64,)r7r-rZrJr3rgrhri)rFrlrjr3 encoded_datar0r0r1_as_urls  ro encoded_imagecCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)rEopenr_r`rg b64decode)rpr"r0r0r1 _b64_to_imagesrscCt|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r'loadsrirIr0r0r1_bytes_to_listrwcCrt)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rurIr0r0r1_bytes_to_dictrxrycCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rErqr_r`)rFr"r0r0r1_bytes_to_image srzrecCst|tr t|S|Sr4)r7r/r'rv)rer0r0r1_as_dictsr{bytes_output_as_linesdetailsc csD|D]}zt||}Wn tyYdSw|dur|VqdS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationr|r} byte_payloadoutputr0r0r1 _stream_text_generation_responses rc CsN|2z 3dHW}zt||}Wn tyYdSw|dur#|Vq6dS)z/Used in `AsyncInferenceClient.text_generation`.Nr~rr0r0r1&_async_stream_text_generation_response's rrcCs~|dsdS|dkrtd|d}t|dd}|ddur2t |d|dt |}|s=|j j S|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rmz/nerror error_type)rZstriprrir'rvlstriprstripr[_parse_text_generation_errorrparse_obj_as_instancetokentext)rr}payload json_payloadrr0r0r1r5s    r bytes_linesc csB|D]}zt|}Wn tyYdSw|dur|VqdS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputrritemrr0r0r1 _stream_chat_completion_responseKs  rc CsL|2z3dHW}zt|}Wn tyYdSw|dur"|Vq6dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrr0r0r1&_async_stream_chat_completion_responseXs  rcCsn|dsdS|dkrtd|d}t|dd}|ddur2t |d|dt |Sr) rZrrrir'rvrrr[rrr)rrrr0r0r1res    rclientr rcCsHz|j2z 3dHW}|Vq6W|IdHdS|IdHwr4)rFrclose)rrerr0r0r1_async_yield_fromzs  "r#_UNSUPPORTED_TEXT_GENERATION_KWARGSr&unsupported_kwargscCst|g|dSr4)r setdefaultextend)r&rr0r0r1'_set_unsupported_text_generation_kwargssrcCs t|gSr4)rr[)r&r0r0r1'_get_unsupported_text_generation_kwargss r http_errorcCs^zt|ddp |j}|d}|d}Wn ty |w|dur-t||}|||)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. response_error_payloadNrr)getattrrer'r[ Exceptionr)rrrr exceptionr0r0r1raise_text_generation_errors    rrrcCsH|dkrt|S|dkrt|S|dkrt|S|dkr t|St|S)N generationincomplete_generation overloaded validation)rrrrr)rrr0r0r1rsr)Sr<rgr_r'loggingrW dataclassesrpathlibrtypingrrrrrr r r r r rrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesrrr?rr PIL.Imager"r-UrlTPathTr/rRrSContentTTASKS_EXPECTING_IMAGES getLoggerr*rUr#r2r@rCrErJrkrorsrwryrzr{boolrrrrrrrrr.rrrrr0r0r0r1s  8         B            "