R`i n d dl mZmZ ddlmZ ddlmZ ddlmZm Z m
Z
ddl m Z m
Z
mZmZ G d de Zy )
)OptionalUnion )
CharSetProber)CodingStateMachine)LanguageFilter MachineState ProbingState) HZ_SM_MODELISO2022CN_SM_MODELISO2022JP_SM_MODELISO2022KR_SM_MODELc e Zd ZdZej
fdeddf fd
Zd fd Zede e
fd Z ede e
fd Z de
fd Zd
eeef defd Z xZS )
EscCharSetProberz
This CharSetProber uses a "code scheme" approach for detecting encodings,
whereby easily recognizable escape or shift sequences are relied on to
identify these encodings.
lang_filterreturnNc t | | g | _ | j t j
z rP| j j
t t | j j
t t | j t j z r(| j j
t t | j t j z r(| j j
t t d| _ d | _ d | _ t" j$ | _ | j) y )N)r r )super__init__ coding_smr r CHINESE_SIMPLIFIEDappendr r r JAPANESEr
KOREANr active_sm_count_detected_charset_detected_languager
DETECTING_statereset)selfr __class__s /builddir/build/BUILDROOT/alt-python312-pip-23.3.1-3.el8.x86_64/opt/alt/python312/lib/python3.12/site-packages/pip/_vendor/chardet/escprober.pyr zEscCharSetProber.__init__0 s
[1 n ? ? ? NN ! !"4["A B NN ! !"45G"H I n 5 5 5 NN ! !"45G"H I n 3 3 3 NN ! !"45G"H I 04 15 ",,
c t | | j D ] }d|_ |j t | j | _ d | _ d | _ y )NT)r r r activelenr r r )r! r r" s r# r zEscCharSetProber.reset@ sO
I #I OO ( #4>> 2 !% "& r$ c | j S Nr r! s r# charset_namez EscCharSetProber.charset_nameI s %%%r$ c | j S r) )r r+ s r# languagezEscCharSetProber.languageM s &&&r$ c " | j rdS dS )NgGz?g r* r+ s r# get_confidencez EscCharSetProber.get_confidenceQ s --t747r$ byte_strc
|D ] }| j D ] }|j s|j | }|t j k( rQd|_ | xj
dz c_ | j
dk s`t j | _ | j c c S |t j k( st j | _ |j | _
|j | _ | j c c S | j S )NFr r )r r&
next_stater ERRORr r
NOT_MEr stateITS_MEFOUND_ITget_coding_state_machiner r. r )r! r1 cr coding_states r# feedzEscCharSetProber.feedT s A !^^ '' ( 3 3A 6 <#5#55',I$((A-(++q0&2&9&9 #zz)!\%8%88"."7"7DK-6-O-O-QD*.7.@.@D+ ::% , " zzr$ )r N)__name__
__module__ __qualname____doc__r NONEr r propertyr strr, r. floatr0 r bytes bytearrayr
r<
__classcell__)r" s @r# r r ) s 6D5H5H N T ' &hsm & & '(3- ' '8 8U5)#3 4 r$ r N)typingr r
charsetproberr codingstatemachiner enumsr r r
escsmr r r
r r r$ r# rN s, 8 # ( 2 = = =} =r$