U
f& @ s d dl Z d dlZd dlmZ d dlmZmZmZmZm Z d dl
m Z d dl m
Z
mZ d dlmZ d dlmZ d dlmZ d dlmZ d d lmZ deeed d d
Z dee
e e dddZ e dkre dS ) N)dumps)abspathbasenamedirnamejoinrealpath)python_version)ListOptional)unidata_version)from_fp)CliDetectionResult) __version__yes)questiondefaultreturnc C s dddddd}|dkr d}n(|dkr,d}n|dkr:d }n t d
| tj| | t }|dk rx|d krx|| S ||kr|| S tjd qFdS )
a Ask a yes/no question via input() and return their answer.
"question" is a string that is presented to the user.
"default" is the presumed answer if the user just hits .
It must be "yes" (the default), "no" or None (meaning
an answer is required of the user).
The "answer" return value is True for "yes" or False for "no".
Credit goes to (c) https://stackoverflow.com/questions/3041986/apt-command-line-interface-like-yes-no-input
TF)r yZyenonNz [y/n] r z [Y/n] r z [y/N] z invalid default answer: '%s' z3Please respond with 'yes' or 'no' (or 'y' or 'n').
)
ValueErrorsysstdoutwriteinputlower)r r Zvalidpromptchoice r R/opt/alt/python38/lib64/python3.8/site-packages/charset_normalizer/cli/__main__.py query_yes_no s
r! )argvr c
s t jdd}|jdt dddd |jdd d
d d d
d |jddd
d ddd |jddd
d ddd |jddd
d ddd |jdd d
d d d d |jd d d
d d!d"d |jd#d$d%d&td'd(d) |jd*d+d,tt tt j
d-rd.nd/d0d1 |
| }|jd2kr(|jd kr(td3tjd4 d5S |jd2krR|jd krRtd6tjd4 d5S |jd7k sj|jd8kr|td9tjd4 d5S g }|jD ]ĉt|j|jd:}| d;krtd<j|jd8k rd=nd>tjd4 |tt jd;g g d?g d d8d7d;d2 n2|tt j j j fd@dA j D j j! j" j# j$d;d2 t%|d5kr|j&r|D ]V krd|tt jj j fdBdAj D j j!j"j#j$d;d qd|jd2kr6 j 'dCd2krtdDjtjd4 j(d kr) qt*t+j}t,t+j}|-dE}|jd kr^|.dF j j(d kr) n<|jd krt/dGjdHd krj(d kr) qzHt0|dE0||dI _1t2|dI j1dJdKdL}|3t4 W 5 Q R X W nR t5k
r4 } z2tt4| tjd4 j(d kr ) W Y dMS d;} ~ X Y nX j(d kr) q|j6d krtt7t%|d5krzdNdA |D n|dI j8d2dOdP n*|jD ]"tdQ0fdRdA|D qdIS )Sz
CLI assistant using ARGV and ArgumentParser
:param argv:
:return: 0 if everything is fine, anything else equal trouble
zvThe Real First Universal Charset Detector. Discover originating encoding used on text file. Normalize text to unicode.) descriptionfilesrb+zFile(s) to be analysed)typenargshelpz-vz --verbose
store_trueFverbosezjDisplay complementary information about file if any. Stdout will contain logs about the detection process.)actionr destr) z-az--with-alternative alternativeszIOutput complementary possibilities if any. Top-level JSON WILL be a list.z-nz --normalize normalizezLPermit to normalize input file. If not set, program does not write anything.z-mz --minimalminimalzBOnly output the charset detected to STDOUT. Disabling JSON output.z-rz --replacereplacezGReplace file when trying to normalize it instead of creating a new one.z-fz--forceforcezHReplace file without asking if you are sure, use this flag with caution.z-tz --thresholdstoreg? thresholdzUDefine a custom maximum amount of chaos allowed in decoded content. 0. <= chaos <= 1.)r, r r' r- r) z --versionversionz;Charset-Normalizer {} - Python {} - Unicode {} - SpeedUp {}z.pyZOFFONz"Show version information and exit.)r, r5 r) Tz.Use --replace in addition of --normalize only.)file z*Use --force in addition of --replace only.g g ?z---threshold VALUE should be between 0. AND 1.)r4 explainNz4Unable to identify originating encoding for "{}". {}z-Maybe try increasing maximum amount of chaos.r Unknownc s g | ]}| j kr|qS r encoding.0cp)
best_guessr r
s
z cli_detect..c s g | ]}| j kr|qS r r; r= )elr r rA s
utfzJ"{}" file does not need to be normalized, as it already came from unicode..z0Are you sure to normalize "{}" by replacing it ?r r wzutf-8r; c S s g | ]
}|j qS r )__dict__r> rB r r r rA s ) ensure_asciiindentz, c s& g | ] }|j t jkr|jp d qS ) undefined)pathr namer< rI )my_filer r rA s )9argparseArgumentParser add_argumentFileTypefloatformatr r r md_module__file__r endswith
parse_argsr1 r/ printr stderrr2 r4 r$ r r+ bestrO appendr
r r< Zencoding_aliasesZcould_be_from_charsetlanguageZ alphabetsbomZ
percent_chaosZpercent_coherencelenr.
startswithclosedcloser r r splitinsertr! r Z unicode_pathopenr strIOErrorr0 r rH )
r" parserargsZx_matchesZdir_path file_nameZo_fper )r@ rB rP r
cli_detect0 s
$
rp __main__)r )N) rQ r jsonr os.pathr r r r r platformr typingr r
unicodedatar Zcharset_normalizer.mdmdrW Zcharset_normalizerr Zcharset_normalizer.modelsr
Zcharset_normalizer.versionr rh boolr! intrp __name__r r r r s ! x