o òÜÓh(ã@s„ddlmZejZejZejZejZejZejZejZej Z ej Z ej Z ej Z ej Z ejZejZeeeedœZdedefdd„ZdS)é)Ú normalizers)ÚnfcÚnfdÚnfkcÚnfkdÚ normalizerÚreturncCs&|tvrtd |t ¡¡ƒ‚t|ƒS)Nz6{} is not a known unicode normalizer. Available are {})Ú NORMALIZERSÚ ValueErrorÚformatÚkeys)r©r úU/var/www/html/ai/venv/lib/python3.10/site-packages/tokenizers/normalizers/__init__.pyÚunicode_normalizer_from_strs ÿ rN)ÚrÚ NormalizerÚBertNormalizerÚNFDÚNFKDÚNFCÚNFKCÚSequenceÚ LowercaseÚPrependÚStripÚ StripAccentsÚNmtÚ PrecompiledÚReplacer Ústrrr r r rÚs"