3
¥íX¥ ã @ s` d dl mZmZ d dlmZ d dlmZ d dlmZ d dl m
Z
d dl m Z G dd„ deƒZ
d S )
é )Ú ProbingStateÚ MachineState)ÚMultiByteCharSetProber)ÚCodingStateMachine)ÚEUCJPDistributionAnalysis)ÚEUCJPContextAnalysis)ÚEUCJP_SM_MODELc sP e Zd Z‡ fdd„Z‡ fdd„Zedd„ ƒZedd„ ƒZd d
„ Zd d „ Z ‡ Z
S )
Ú EUCJPProberc s4 t t| ƒjƒ ttƒ| _tƒ | _tƒ | _ | j
ƒ d S )N) Úsuperr Ú__init__r r Ú coding_smr Údistribution_analyzerr Úcontext_analyzerÚreset)Úself)Ú __class__© ú!/usr/lib/python3.6/eucjpprober.pyr % s
zEUCJPProber.__init__c s t t| ƒjƒ | jjƒ d S )N)r
r r r )r )r r r r , s zEUCJPProber.resetc C s dS )NzEUC-JPr )r r r r Ú charset_name0 s zEUCJPProber.charset_namec C s dS )NZJapaneser )r r r r Úlanguage4 s zEUCJPProber.languagec C s6 xît t|ƒƒD ]Þ}| jj|| ƒ}|tjkrN| jjd| j| j |ƒ t
j | _ P q|tj
krdt
j| _ P q|tjkr| jjƒ }|dkr°|d | jd< | jj| j|ƒ | jj| j|ƒ q| jj||d |d … |ƒ | jj||d |d … |ƒ qW |d | jd< | jt
jkr0| jjƒ r0| jƒ | jkr0t
j| _ | jS )Nz!%s %s prober hit error at byte %sé r éÿÿÿÿ)ÚrangeÚlenr Z
next_stater ZERRORZloggerÚdebugr r r ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenZ
_last_charr Úfeedr
ÚstateZ DETECTINGZgot_enough_dataÚget_confidenceZSHORTCUT_THRESHOLD)r Zbyte_strÚiZ coding_stateZchar_lenr r r r 8 s4
zEUCJPProber.feedc C s | j jƒ }| jjƒ }t||ƒS )N)r r r
Úmax)r Z context_confZ distrib_confr r r r Y s
zEUCJPProber.get_confidence) Ú__name__Ú
__module__Ú __qualname__r r Úpropertyr r r r Ú
__classcell__r r )r r r $ s !r N)Zenumsr r Zmbcharsetproberr Zcodingstatemachiner Zchardistributionr Zjpcntxr Zmbcssmr r r r r r Ú s