U
.eN @ s d Z ddlZddlZddlZejd dkr@dZeefZdd Z ndZeZe
Z e Z
dd Z ejd k rpeZd
d Znd d Zeed
rddlmZ zddlmZ W n ek
r ddlmZ Y nX dZG dd deZndZddlm Z dd Zddl m Z m Z m Z m!Z!m"Z" ddl#m$Z$ dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,dZ-dZ.d Z/e0e1fd d Z2d d Z3d!d" Z4d#d$ Z5ejd%k rd,d&d'Z6nej7Z6G d(d) d)eZ8G d*d+ d+eZ9dS )-z.Fallback pure Python implementation of msgpack N Tc C s | S N)Z iteritemsd r @/usr/lib/python3.8/site-packages/pip/_vendor/msgpack/fallback.pydict_iteritems s r Fc C s | S r )itemsr r r r r s ) c C s. t | jdko,t| jd to,| jd dS )N r z maximum recursion depth exceeded)lenargs
isinstancestr
startswither r r _is_recursionerror s r c C s dS )NTr r r r r r s Zpypy_version_info) newlist_hint) BytesBuilder)
StringBuilderc @ s& e Zd Zd ddZdd Zdd ZdS )
StringIO c C s, |r t t|| _| j| nt | _d S r )r r
builderappendselfsr r r __init__* s zStringIO.__init__c C s6 t |tr| }nt |tr&t|}| j| d S r )r
memoryviewtobytes bytearraybytesr r r r r r write0 s
zStringIO.writec C s
| j S r )r Zbuildr r r r getvalue6 s zStringIO.getvalueN)r )__name__
__module__ __qualname__r r$ r& r r r r r ) s
r )BytesIOc C s g S r r )sizer r r ; r r, r )
BufferFull OutOfData ExtraData FormatError
StackError)ExtTyper
r i c C s( |||kr|| |kS || |kS d S r r )objttypetupler r r _check_type_strictX s r8 c C sd z t | }W n@ tk
rL trFt t| }tjdt| tdd n Y nX |jdkr`t d|S )Nzusing old buffer interface to unpack %s; this leads to unpacking errors if slicing is used and will be removed in a future versionr
stacklevelr z$cannot unpack from multi-byte object)
r TypeErrorPY2bufferwarningswarnr6 RuntimeWarningitemsize
ValueError)r4 viewr r r _get_data_from_buffer_ s
rD c K s$ t jdtdd | }t|f|S )NzbDirect calling implementation's unpack() is deprecated, Use msgpack.unpack() or unpackb() instead.r r9 )r> r? DeprecationWarningreadunpackb)streamkwargsdatar r r unpackq s rK c
K s t ddt| i|}|| z | }W nJ tk
rH tdY n0 tk
rv } zt|rdt W 5 d}~X Y nX | rt
|| |S )aw
Unpack an object from `packed`.
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``ValueError`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
See :class:`Unpacker` for options.
Nmax_buffer_sizez Unpack failed: incomplete input)N) Unpackerr
feed_unpackr. rB RecursionErrorr r1 _got_extradatar/ _get_extradata)ZpackedrI Zunpackerretr r r r rG y s
rG )r c C s t | t||S )z.Explicit typcast for legacy struct.unpack_from)struct unpack_fromr# )fbor r r _unpack_from s r[ c @ s e Zd ZdZdddddddddddedddddfddZd d
Zd d Zd
d Zdd Z dd Z
dd Z dd Z e
fddZe
fddZdd Zd d ZeZd d Zd!d" Zd#d$ Zd%d& Zd'd( ZdS ))rM a
Streaming unpacker.
arguments:
:param file_like:
File-like object having `.read(n)` method.
If specified, unpacker reads serialized data from it and :meth:`feed()` is not usable.
:param int read_size:
Used as `file_like.read(read_size)`. (default: `min(16*1024, max_buffer_size)`)
:param bool use_list:
If true, unpack msgpack array to Python list.
Otherwise, unpack to Python tuple. (default: True)
:param bool raw:
If true, unpack msgpack raw to Python bytes (default).
Otherwise, unpack to Python str (or unicode on Python 2) by decoding
with UTF-8 encoding (recommended).
Currently, the default is true, but it will be changed to false in
near future. So you must specify it explicitly for keeping backward
compatibility.
*encoding* option which is deprecated overrides this option.
:param bool strict_map_key:
If true, only str or bytes are accepted for map (dict) keys.
It's False by default for backward-compatibility.
But it will be True from msgpack 1.0.
:param callable object_hook:
When specified, it should be callable.
Unpacker calls it with a dict argument after unpacking msgpack map.
(See also simplejson)
:param callable object_pairs_hook:
When specified, it should be callable.
Unpacker calls it with a list of key-value pairs after unpacking msgpack map.
(See also simplejson)
:param str encoding:
Encoding used for decoding msgpack raw.
If it is None (default), msgpack raw is deserialized to Python bytes.
:param str unicode_errors:
(deprecated) Used for decoding msgpack raw with *encoding*.
(default: `'strict'`)
:param int max_buffer_size:
Limits size of data waiting unpacked. 0 means system's INT_MAX (default).
Raises `BufferFull` exception when it is insufficient.
You should set this parameter when unpacking data from untrusted source.
:param int max_str_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of str. (default: max_buffer_size or 1024*1024)
:param int max_bin_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of bin. (default: max_buffer_size or 1024*1024)
:param int max_array_len:
Limits max length of array.
(default: max_buffer_size or 128*1024)
:param int max_map_len:
Limits max length of map.
(default: max_buffer_size//2 or 32*1024)
:param int max_ext_len:
Deprecated, use *max_buffer_size* instead.
Limits max size of ext type. (default: max_buffer_size or 1024*1024)
Example of streaming deserialize from file-like object::
unpacker = Unpacker(file_like, raw=False, max_buffer_size=10*1024*1024)
for o in unpacker:
process(o)
Example of streaming deserialize from socket::
unpacker = Unpacker(raw=False, max_buffer_size=10*1024*1024)
while True:
buf = sock.recv(1024**2)
if not buf:
break
unpacker.feed(buf)
for o in unpacker:
process(o)
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``OutOfData`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
Nr TFc C s | d k rt jdtdd |
d kr$d}
|d kr4d| _n t|jsFtd|| _d| _t | _ d| _
d| _ |
d krv| ptd
}
|d kr| pd
}|d kr| pd }|d kr| d pd }|d kr| pd
}| pd
| _ || j krt
d|pt| j d| _t|| _t|| _| | _|
| _|| _|| _|| _|| _| | _|
| _|| _|| _ || _ || _ d| _ |d k rft|sftd|d k rt|std|d k rt|std|d k r|d k rtdt| stdd S )N.encoding is deprecated, Use raw=False instead.r r9 strictTz!`file_like.read` must be callableFr r\ i i i iz.read_size must be smaller than max_buffer_sizei @ z`list_hook` is not callablez `object_hook` is not callablez#`object_pairs_hook` is not callablez8object_pairs_hook and object_hook are mutually exclusivez`ext_hook` is not callable) r> r? rE _feedingcallablerF r; file_liker" _buffer_buff_i_buf_checkpoint_max_buffer_sizerB min
_read_sizebool_raw_strict_map_key _encoding_unicode_errors _use_list
_list_hook _object_hook_object_pairs_hook _ext_hook _max_str_len _max_bin_len_max_array_len _max_map_len _max_ext_len_stream_offset)r ra Z read_sizeZuse_listrawZstrict_map_keyZ object_hookZobject_pairs_hookZ list_hookencodingunicode_errorsrL Zext_hookZ max_str_lenZ max_bin_lenZ
max_array_lenZ max_map_lenZ max_ext_lenr r r r sp
zUnpacker.__init__c C sh t |}t| j| j t| | jkr*t| jdkrX| jd | j= | j| j8 _d| _| j| d S Nr )rD r
rb rc re r- rd extend)r Z
next_bytesrC r r r rN P s
z
Unpacker.feedc C s" | j | j| j 7 _ | j| _dS )z+ Gets rid of the used parts of the buffer. N)rw rc rd r% r r r _consume_ s zUnpacker._consumec C s | j t| jk S r )rc r
rb r% r r r rQ d s zUnpacker._got_extradatac C s | j | jd S r )rb rc r% r r r rR g s zUnpacker._get_extradatac C s
| |S r )_readr nr r r
read_bytesj s zUnpacker.read_bytesc C s, | | | j}|| | _| j||| S r )_reserverc rb )r r ir r r r~ m s
zUnpacker._readc C s t | j| j | }|dkr d S | jr2| j| _t| jdkr`| jd | j= | j| j8 _d| _| }|dkrt| j|}| j |}|sq| j|7 _|t |8 }qft | j|| j k rd| _td S r{ )
r
rb rc r_ rd r. maxrg ra rF )r r Z remain_bytesZ
to_read_bytesZ read_datar r r r t s*
zUnpacker._reservec C s&
t }d}d }| d | j| j }| jd7 _|d@ dkrD|} n|d@ dkr`d|dA } n|d@ dkr|d@ }t}|| jkrtd || j| |} n~|d
@ d kr|d @ }t}|| j krtd
|| j nJ|d
@ dkr
|d @ }t
}|| j k
r td|| j n|dkr d } n |dkr.d}n|dkr@d}n|dkrt }| d | j| j }| jd7 _|| j
krtd|| j
f | |}n~|dkrt }| d td| j| jd }| jd7 _|| j
krtd|| j
f | |}n|dkrjt }| d td| j| jd }| jd7 _|| j
kr\td|| j
f | |}n|d krt}| d td | j| j\}}| jd7 _|| jkrtd || jf | |}nL|d kr6t}| d td!| j| j\}}| jd 7 _|| jkr(td || jf | |}n|d"krt}| d# td$| j| j\}}| jd#7 _|| jkrtd || jf | |}n|d%kr| d td&| j| jd }| jd7 _nF|d'kr| d( td)| j| jd }| jd(7 _n |d*krB| d | j| j }| jd7 _n|d+kr|| d td| j| jd }| jd7 _n|d,kr| d td| j| jd }| jd7 _nf|d-kr| d( td.| j| jd }| jd(7 _n,|d/kr*| d td0| j| jd }| jd7 _n|d1krd| d td2| j| jd }| jd7 _n|d3kr| d td4| j| jd }| jd7 _n~|d5kr| d( td6| j| jd }| jd(7 _nD|d7kr4t}| jdk rtd d| jf | d td8| j| j\}}| jd7 _n|d9krt}| jdk r`td d| jf | d td:| j| j\}}| jd 7 _n|d;krt}| jdk rtd d| jf | d# td<| j| j\}}| jd#7 _n0|d=krHt}| jd(k rtd d(| jf | d> td?| j| j\}}| jd>7 _n|d@krt}| jdAk rttd dA| jf | dB tdC| j| j\}}| jdB7 _nx|dDkrt}| d | j| j }| jd7 _|| jkrtd || j| |}n |dEkr^t}| d td| j| j\}| jd7 _|| jkrPtd || j| |}n|dFkrt}| d td| j| j\}| jd7 _|| jkrtd || j| |}n^|dGk rt}| d td| j| j\}| jd7 _|| j k
r td
|| j n|dHk rht}| d td| j| j\}| jd7 _|| j k
r td
|| j n|dIk r| d td| j| j\}| jd7 _|| j k rtd|| j t
}n`|dJk
r| d td| j| j\}| jd7 _|| j k
r
td|| j t
}n tdK| |||fS )LNr r r\ z%s exceeds max_str_len(%s) z %s exceeds max_array_len(%s)z%s exceeds max_map_len(%s) F T z%s exceeds max_bin_len(%s) r >H r3 >I ZBbz%s exceeds max_ext_len(%s) r
z>Hb r z>Ib z>f z>d z>Q rY z>h z>i z>q Zb1s Zb2s Zb4s Zb8s Zb16s zUnknown header: 0x%x)TYPE_IMMEDIATEr rb rc TYPE_RAWrr rB r~
TYPE_ARRAYrt TYPE_MAPru TYPE_BINrs r[ TYPE_EXTrv r0 )r executetypr r4 rY Lr r r _read_header s
zUnpacker._read_headerc s |\}}}|tkr,|tkr(td|S |tkrH|tkrDtd|S |tkr|tkrtt|D ]} t q`d S t |}t|D ]}|
t q j d k r |} j
r|S t|S |tkr|tkrt|D ]} t t qd S jd k r" fddt|D }npi }t|D ]L} t } jrjt|ttfkrjtdtt| t ||< q. jd k r |}|S |tkrd S |tkr jd k r| j j}n jrt|}n
|d}|S |tkr |t|S |t krt|S |S )NzExpected arrayz Expected mapc 3 s" | ]} t tfV qd S r )rO EX_CONSTRUCT).0_r% r r s z#Unpacker._unpack..z %s is not allowed for map keyutf_8) r EX_READ_ARRAY_HEADERr rB EX_READ_MAP_HEADERr EX_SKIPxrangerO r r r rn rm r7 rp rj r6 unicoder# r ro r rk decoderl ri r rq r ) r r r r r4 r rS r keyr r% r rO h sj
zUnpacker._unpackc C s | S r r r% r r r __iter__ s zUnpacker.__iter__c C sT z| t}| |W S tk
r8 | tY n tk
rN tY nX d S r )rO r r} r.
StopIterationrP r1 r rS r r r __next__ s
zUnpacker.__next__c C s | t | d S r )rO r r} r% r r r skip s
z
Unpacker.skipc C s4 z| t}W n tk
r& tY nX | |S r )rO r rP r1 r} r r r r rK s
zUnpacker.unpackc C s | t}| |S r )rO r r} r r r r read_array_header s
zUnpacker.read_array_headerc C s | t}| |S r )rO r r} r r r r read_map_header s
zUnpacker.read_map_headerc C s | j S r )rw r% r r r tell s z
Unpacker.tell)r' r( r) __doc__r2 r rN r} rQ rR r r~ r r r rO r r nextr rK r r r r r r r rM sB a
R U @ rM c @ s e Zd ZdZd#ddZeeefddZd d
Z d d Z
d
d Z dd Z dd Z
dd Zdd ZefddZdd Zdd Zd d Zd d Zd!d" ZdS )$Packerah
MessagePack Packer
usage:
packer = Packer()
astream.write(packer.pack(a))
astream.write(packer.pack(b))
Packer's constructor has some keyword arguments:
:param callable default:
Convert user type to builtin type that Packer supports.
See also simplejson's document.
:param bool use_single_float:
Use single precision float type for float. (default: False)
:param bool autoreset:
Reset buffer after each pack and return its content as `bytes`. (default: True).
If set this to false, use `bytes()` to get content and `.reset()` to clear buffer.
:param bool use_bin_type:
Use bin type introduced in msgpack spec 2.0 for bytes.
It also enables str8 type for unicode.
:param bool strict_types:
If set to true, types will be checked to be exact. Derived classes
from serializeable types will not be serialized and will be
treated as unsupported type and forwarded to default.
Additionally tuples will not be serialized as lists.
This is useful when trying to implement accurate serialization
for python types.
:param str encoding:
(deprecated) Convert unicode to bytes with this encoding. (default: 'utf-8')
:param str unicode_errors:
Error handler for encoding unicode. (default: 'strict')
NFTc C sx |d krd}nt jdtdd |d kr*d}|| _|| _|| _|| _|| _|| _t | _
|d k rnt |snt d|| _
d S )Nr r] r r9 r^ zdefault must be callable)r> r? rE
_strict_types
_use_float
_autoreset
_use_bin_typerk rl r rb r` r; _default)r defaultry rz Zuse_single_floatZ autoresetZ use_bin_typeZ strict_typesr r r r s( zPacker.__init__c C sd d}| j r|}t}nttf}|dk r,td|d kr@| jdS ||trf|rZ| jdS | jdS ||trd| krdk rn n| jt d|S d | krdk rn n| jt d
|S d| krd krn n| jt d d
|S d| krdk r*n n| jt dd|S d | k rBdkr\n n| jt dd|S d| krtdk rn n| jt dd|S d| k rdkrn n| jt dd|S d| krdk rn n| jt dd |S d| k r
d kr$n n| jt d d |S d | krBbr >BHr i z>Bhr >BIr i z>Bir l z>BQr l z>Bqr TzInteger value out of range z%s is too largez5Can't encode unicode string: no encoding is specifiedzString is too largezMemoryview is too largez>Bfr z>Bdr r r r3 r r >BBr r r zCannot serialize %r)%r listr7 rB rb r$ rh int_typesrV packr
OverflowErrorr# r" r
r6 r' _pack_bin_headerr rk r; encoderl _pack_raw_headerr rA floatr r2 coderJ _pack_array_headerr _packdict_pack_map_pairsr ) r r4
nest_limitZcheckZcheck_type_strictZ default_usedZ
list_typesr r rJ r r r r r r s
z Packer._packc C sF z| | W n t | _ Y nX | jrB| j }t | _|S d S r )r r rb r r& )r r4 rS r r r r s
z Packer.packc C s0 | t|| | jr,| j }t | _|S d S r )r r
r rb r& r )r pairsrS r r r pack_map_pairs s
zPacker.pack_map_pairsc C s6 |dkr t | | | jr2| j }t | _|S d S Nr )rB r r rb r& r r r rS r r r pack_array_header s
zPacker.pack_array_headerc C s6 |dkr t | | | jr2| j }t | _|S d S r )rB _pack_map_headerr rb r& r r r r r pack_map_header s
zPacker.pack_map_headerc C sJ t |tstdd| kr&dks0n tdt |tsBtdt|}|dkrZtd|dkrp| jd n|d
kr| jd n|d kr| jd
n|dkr| jd nt|dkr| jd n^|dkr| jdt d| n<|dkr| jdt d| n| jdt d| | jt d| | j| d S )Nz typecode must have int type.r ztypecode should be 0-127zdata must have bytes typer zToo large datar r r r r3 r r r r r r r r r r )
r intr; rB r# r
rb r$ rV r )r typecoderJ r r r r
pack_ext_type s4
zPacker.pack_ext_typec C sh |dkr | j tdd| S |dkr>| j tdd|S |dkr\| j tdd |S td
d S ) Nr r r r r r r r r zArray is too largerb r$ rV r rB r r r r r s zPacker._pack_array_headerc C sh |dkr | j tdd| S |dkr>| j tdd|S |dkr\| j tdd |S td
d S ) Nr r r r r r r r r zDict is too larger r r r r r s zPacker._pack_map_headerc C s< | | |D ](\}}| ||d | ||d qd S )Nr )r r )r r r r kvr r r r s
zPacker._pack_map_pairsc C s |dkr"| j tdd| nn| jrH|dkrH| j tdd| nH|dkrh| j tdd | n(|d
kr| j td d | ntd
d S )Nr r r r r r r r r r r r zRaw is too large)rb r$ rV r r rB r r r r r s zPacker._pack_raw_headerc C sv | j s| |S |dkr.| jtdd|S |dkrL| jtdd|S |dkrj| jtdd |S td
d S ) Nr r r r r r r r r zBin is too large)r r rb r$ rV r rB r r r r r s
zPacker._pack_bin_headerc C s
| j S )z/Return internal buffer contents as bytes object)rb r& r% r r r r# s z Packer.bytesc C s t | _dS )zYReset internal buffer.
This method is usaful only when autoreset=False.
N)r rb r% r r r reset s z Packer.resetc C s" t strt| S | j S dS )z Return view of internal buffer.N)USING_STRINGBUILDERr< r r# rb getbufferr% r r r r s zPacker.getbuffer)NNNFTFF)r' r( r) r r DEFAULT_RECURSE_LIMITr r8 r r r r r r r r r r r r# r r r r r r r s0 (
n r )r ):r sysrV r> version_infor< r Zlongr r r r ranger RuntimeErrorrP r hasattrZ__pypy__r Z__pypy__.buildersr r ImportErrorr objectr ior*
exceptionsr- r. r/ r0 r1 r2 r r r r r r r r r r r
r6 r7 r8 rD rK rG r[ rW rM r r r r r sj
: