3
Pf @ s d Z ddlZddlZddlZddlZddlmZ ddlm Z ddl
m Z ddl m
Z
mZmZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZmZm Z dd
l m Z m Z m Z m!Z!m"Z"m#Z#m$Z$ ddl%m&Z&m'Z' ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2 ddl3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ? ddl@mAZA eAjBeAjCeAjDeAjEeAjFfZGdZHd!ZIdZJG dd deKZLG dd deKZMG dd d eMZNG d d d eLeMZOG d d d eKZPdS )"z`
requests.models
~~~~~~~~~~~~~~~
This module contains the primary objects that power Requests.
N) RequestField)encode_multipart_formdata) parse_url) DecodeErrorReadTimeoutError
ProtocolErrorLocationParseError)UnsupportedOperation )
default_hooks)CaseInsensitiveDict)
HTTPBasicAuth)cookiejar_from_dictget_cookie_header_copy_cookie_jar) HTTPError
MissingSchema
InvalidURLChunkedEncodingErrorContentDecodingErrorConnectionErrorStreamConsumedError)to_native_stringunicode_is_ascii)
guess_filenameget_auth_from_url requote_uri stream_decode_response_unicodeto_key_val_listparse_header_links iter_slicesguess_json_utf super_lencheck_header_validity)
cookielib
urlunparseurlsplit urlencodestrbytesis_py2chardet builtin_str
basestring)json)codes
i i c @ s0 e Zd Zedd Zedd Zedd ZdS )RequestEncodingMixinc C sN g }t | j}|j}|s d}|j| |j}|rD|jd |j| dj|S )zBuild the path URL to use./? )r& urlpathappendqueryjoin)selfr6 pr7 r9 r= /usr/lib/python3.6/models.pypath_url= s
z RequestEncodingMixin.path_urlc C s t | ttfr| S t| dr | S t| drg }x|t| D ]p\}}t |tsVt|d r\|g}xJ|D ]B}|dk rb|jt |tr|jdn|t |tr|jdn|f qbW q8W t|ddS | S dS )zEncode parameters in a piece of data.
Will successfully encode parameters when passed as a dict or a list of
2-tuples. Order is retained if data is a list of 2-tuples but arbitrary
if parameters are supplied as a dict.
read__iter__Nzutf-8T)Zdoseq)
isinstancer( r) hasattrr r- r8 encoder' )dataresultkZvsvr= r= r> _encode_paramsR s
$ z#RequestEncodingMixin._encode_paramsc C s | st dnt|tr t dg }t|p,i }t| p8i } x|D ]\}}t|ts`t|d rf|g}x\|D ]T}|dk rlt|tst|}|jt|tr|jdn|t|tr|j dn|f qlW qBW x| D ]\}}d}d} t|t
t fr.t |dkr|\}
} n&t |dkr |\}
} }n |\}
} }} nt
|p:|}
|} t| tttfrX| } n| j } t|| |
| d}
|
j|d |j|
qW t|\}}||fS )
a Build the body for a multipart/form-data request.
Will successfully encode files when passed as a dict or a list of
tuples. Order is retained if data is a list of tuples but arbitrary
if parameters are supplied as a dict.
The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype)
or 4-tuples (filename, fileobj, contentype, custom_headers).
zFiles must be provided.zData must not be a string.rA Nzutf-8 )namerE filenameheaders) content_type)
ValueErrorrB r- r rC r) r( r8 decoderD tuplelistlenr bytearrayr@ r Zmake_multipartr )filesrE Z
new_fieldsZfieldsZfieldvalrH rG ZftZfhfnfpZfdataZrfbodyrO r= r= r>
_encode_filesm sH
$
z"RequestEncodingMixin._encode_filesN)__name__
__module__ __qualname__propertyr? staticmethodrI r[ r= r= r= r> r2 < s r2 c @ s e Zd Zdd Zdd ZdS )RequestHooksMixinc C s\ || j krtd| t|tjr4| j | j| n$t|drX| j | jdd |D dS )zProperly register a hook.z1Unsupported event specified, with event name "%s"rA c s s | ]}t |tjr|V qd S )N)rB collectionsCallable).0hr= r= r> s z2RequestHooksMixin.register_hook..N)hooksrP rB rb rc r8 rC extend)r; eventhookr= r= r>
register_hook s
z RequestHooksMixin.register_hookc C s. y| j | j| dS tk
r( dS X dS )ziDeregister a previously registered hook.
Returns True if the hook existed, False if not.
TFN)rg removerP )r; ri rj r= r= r> deregister_hook s
z!RequestHooksMixin.deregister_hookN)r\ r] r^ rk rm r= r= r= r> ra s ra c
@ s* e Zd ZdZd ddZdd Zdd ZdS )
Requesta A user-created :class:`Request ` object.
Used to prepare a :class:`PreparedRequest `, which is sent to the server.
:param method: HTTP method to use.
:param url: URL to send.
:param headers: dictionary of headers to send.
:param files: dictionary of {filename: fileobject} files to multipart upload.
:param data: the body to attach to the request. If a dictionary is provided, form-encoding will take place.
:param json: json for the body to attach to the request (if files or data is not specified).
:param params: dictionary of URL parameters to append to the URL.
:param auth: Auth handler or (user, pass) tuple.
:param cookies: dictionary or CookieJar of cookies to attach to this request.
:param hooks: dictionary of callback hooks, for internal usage.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'http://httpbin.org/get')
>>> req.prepare()
Nc
C s |d kr g n|}|d kr g n|}|d kr,i n|}|d kr __init__ s" zRequest.__init__c C s
d| j S )Nz)rp )r; r= r= r> __repr__ s zRequest.__repr__c C s< t }|j| j| j| j| j| j| j| j| j | j
| j d
|S )zXConstructs a :class:`PreparedRequest ` for transmission and returns it.)
rp r6 rN rV rE r. rq rr rs rg ) PreparedRequestpreparerp r6 rN rV rE r. rq rr rs rg )r; r< r= r= r> rw s
zRequest.prepare)
NNNNNNNNNN)r\ r] r^ __doc__rt ru rw r= r= r= r> rn s
rn c
@ s e Zd ZdZdd Zd ddZdd Zd d
Zd d Ze d
d Z
dd Z dd Z d ddZ
dd Zd ddZdd Zd d ZdS )!rv a The fully mutable :class:`PreparedRequest ` object,
containing the exact bytes that will be sent to the server.
Generated from either a :class:`Request ` object or manually.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'http://httpbin.org/get')
>>> r = req.prepare()
>>> s = requests.Session()
>>> s.send(r)
c C s0 d | _ d | _d | _d | _d | _t | _d | _d S )N)rp r6 rN _cookiesrZ r rg _body_position)r; r= r= r> rt s zPreparedRequest.__init__Nc C sR | j | | j|| | j| | j| | j|||
| j|| | j| dS )z6Prepares the entire request with the given parameters.N)prepare_method prepare_urlprepare_headersprepare_cookies prepare_body prepare_auth
prepare_hooks) r; rp r6 rN rV rE rq rr rs rg r. r= r= r> rw + s
zPreparedRequest.preparec C s
d| j S )Nz)rp )r; r= r= r> ru = s zPreparedRequest.__repr__c C sX t }| j|_| j|_| jd k r*| jj nd |_t| j|_| j|_| j|_| j |_ |S )N)
rv rp r6 rN copyr ry rZ rg rz )r; r< r= r= r> r @ s zPreparedRequest.copyc C s$ || _ | j dk r t| j j | _ dS )z Prepares the given HTTP method.N)rp r upper)r; rp r= r= r> r{ K s
z PreparedRequest.prepare_methodc C s@ dd l }y|j| ddjd} W n |jk
r: tY nX | S )Nr T)Zuts46zutf-8)idnarD rQ Z IDNAError UnicodeError)hostr r= r= r> _get_idna_encoded_hostQ s
z&PreparedRequest._get_idna_encoded_hostc C s0 t |tr|jd}ntr"t|nt|}|j }d|krT|j jd rT|| _ dS yt
|\}}}}}}} W n, t k
r }
zt |
j
W Y dd}
~
X nX |sd} | jt|d} t| |st d| t|sy| j|}W n tk
r t dY nX n|jdrt d|p"d } | r2| d
7 } | |7 } |rP| dt| 7 } |sZd }trt |trv|jd }t | tr| jd } t |tr|jd }t |tr|jd }t | tr| jd } t |ttfrt|}| j|}
|
r|r
d
||
f }n|
}tt|| |d|| g}|| _ dS )z Prepares the given HTTP URL.utf8:ZhttpNzDInvalid URL {0!r}: No schema supplied. Perhaps you meant http://{0}?z Invalid URL %r: No host suppliedzURL has an invalid label.*r5 @r3 zutf-8z%s&%s)rB r) rQ r* Zunicoder( lstriplower
startswithr6 r r r argsformatr r r r r rD rI r r% )r; r6 rq schemerr r Zportr7 r9 ZfragmenteerrorZnetlocZ
enc_paramsr= r= r> r| [ sh
zPreparedRequest.prepare_urlc C s@ t | _|r r} s z PreparedRequest.prepare_headersc C sv d}d}| r8|dk r8d}t j|}t|ts8|jd}tt|dt|ttt t
j f g}y t |}W n t
ttfk
r d}Y nX |r|}t|dddk ry|j | _W n ttfk
r t | _Y nX |rtd|rt|| jd< n
d| jd < np|r| j||\}}n2|rF| j|}t|ts r sJ
z PreparedRequest.prepare_bodyc C sL |dk r$t |}|rHt|| jd< n$| jdkrH| jjddkrHd| jd< dS )z>Prepare Content-Length header based on request method and bodyNzContent-LengthGETHEAD0)r r )r" r, rN rp get)r; rZ r r= r= r> r s z&PreparedRequest.prepare_content_lengthr5 c C sj |dkr"t | j}t|r |nd}|rft|trDt|dkrDt| }|| }| jj|j | j | j
dS )z"Prepares the given HTTP auth data.NrJ ) r r6 anyrB rR rT r
__dict__updater rZ )r; rr r6 Zurl_authrr= r= r> r s
z PreparedRequest.prepare_authc C s@ t |tjr|| _n
t|| _t| j| }|dk r<|| jd< dS )a Prepares the given HTTP cookie data.
This function eventually generates a ``Cookie`` header from the
given cookies using cookielib. Due to cookielib's design, the header
will not be regenerated if it already exists, meaning this function
can only be called once for the life of the
:class:`PreparedRequest ` object. Any subsequent calls
to ``prepare_cookies`` will have no actual effect, unless the "Cookie"
header is removed beforehand.
NZCookie)rB r$ Z CookieJarry r r rN )r; rs Z
cookie_headerr= r= r> r~ $ s
z PreparedRequest.prepare_cookiesc C s* |pg }x |D ]}| j ||| qW dS )zPrepares the given hooks.N)rk )r; rg ri r= r= r> r 8 s
z PreparedRequest.prepare_hooks)
NNNNNNNNNN)N)r5 )r\ r] r^ rx rt rw ru r r{ r` r r| r} r r r r~ r r= r= r= r> rv s
V
E
rv c
@ s e Zd ZdZdddddddd d
d g
Zd d
Zdd Zdd Zdd Zdd Z dd Z
dd Z dd Z d d Z
ed d Zed d! Zed"d# Zed$d% Zed&d' Zd;d*d+Zed,d,fd-d.Zed/d0 Zed1d2 Zd3d4 Zed5d6 Zd7d8 Zd9d: Z d,S )<ResponsezhThe :class:`Response ` object, which contains a
server's response to an HTTP request.
_content status_coderN r6 historyencodingreasonrs elapsedrequestc C s^ d| _ d| _d | _d | _t | _d | _d | _d | _g | _ d | _
t i | _ t
jd| _d | _d S )NFr )r _content_consumed_nextr r rN rawr6 r r r r rs datetimeZ timedeltar r )r; r= r= r> rt L s
zResponse.__init__c C s | S )Nr= )r; r= r= r> __enter__{ s zResponse.__enter__c G s | j d S )N)close)r; r r= r= r> __exit__~ s zResponse.__exit__c s$ j s j t fdd jD S )Nc 3 s | ]}|t |d fV qd S )N)r )rd attr)r; r= r> rf s z(Response.__getstate__..)r contentdict __attrs__)r; r= )r; r> __getstate__ s
zResponse.__getstate__c C s> x |j D ]\}}t| || q
W t| dd t| dd d S )Nr Tr )ro setattr)r; staterL r r= r= r> __setstate__ s zResponse.__setstate__c C s
d| j S )Nz)r )r; r= r= r> ru s zResponse.__repr__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)ok)r; r= r= r> __bool__ s zResponse.__bool__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)r )r; r= r= r> __nonzero__ s zResponse.__nonzero__c C s
| j dS )z,Allows you to use a response as an iterator. ) iter_content)r; r= r= r> rA s zResponse.__iter__c C s& y | j W n tk
r dS X dS )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
FT)raise_for_statusr )r; r= r= r> r s
z Response.okc C s d| j ko| jtkS )zTrue if this Response is a well-formed HTTP redirect that could have
been processed automatically (by :meth:`Session.resolve_redirects`).
location)rN r REDIRECT_STATI)r; r= r= r> is_redirect s zResponse.is_redirectc C s d| j ko| jtjtjfkS )z@True if this Response one of the permanent versions of redirect.r )rN r r/ Zmoved_permanentlypermanent_redirect)r; r= r= r> is_permanent_redirect s z Response.is_permanent_redirectc C s | j S )zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)r )r; r= r= r> next s z
Response.nextc C s t j| jd S )z7The apparent encoding, provided by the chardet library.r )r+ Zdetectr )r; r= r= r> apparent_encoding s zResponse.apparent_encodingr
Fc s~ fdd}j r(tjtr(t n$ dk rLt t rLtdt tj }| }j rh|n|}|rzt |}|S )a Iterates over the response data. When stream=True is set on the
request, this avoids reading the content at once into memory for
large responses. The chunk size is the number of bytes it should
read into memory. This is not necessarily the length of each item
returned as decoding can take place.
chunk_size must be of type int or None. A value of None will
function differently depending on the value of `stream`.
stream=True will read data as it arrives in whatever size the
chunks are received. If stream=False, data is returned as
a single chunk.
If decode_unicode is True, content will be decoded using the best
available encoding based on the response.
c 3 s t jdry$x jj ddD ]
} | V q W W q tk
rZ } zt|W Y d d }~X q tk
r } zt|W Y d d }~X q tk
r } zt|W Y d d }~X qX n x jj } | sP | V qW d_
d S )NstreamT)Zdecode_content) rC r r r r r r r r r@ r )chunkr )
chunk_sizer; r= r> generate s
z'Response.iter_content..generateNz.chunk_size must be an int, it is instead a %s.)
r rB r boolr intr typer r )r; r decode_unicoder Z
reused_chunksZ
stream_chunksZchunksr= )r r; r> r s
zResponse.iter_contentNc c s d}x| j ||dD ]r}|dk r(|| }|r8|j|}n|j }|rn|d rn|rn|d d |d krn|j }nd}x|D ]
}|V qxW qW |dk r|V dS )zIterates over the response data, one line at a time. When
stream=True is set on the request, this avoids reading the
content at once into memory for large responses.
.. note:: This method is not reentrant safe.
N)r r r
r r r )r split
splitlinespop)r; r r Z delimiterpendingr linesliner= r= r>
iter_lines s $
zResponse.iter_linesc C sZ | j dkrN| jrtd| jdks,| jdkr4d| _ nt j| jtpJt | _ d| _| j S )z"Content of the response, in bytes.Fz2The content for this response was already consumedr NT) r r RuntimeErrorr r r) r: r CONTENT_CHUNK_SIZE)r; r= r= r> r * s
zResponse.contentc C sh d}| j }| jstdS | j dkr(| j}yt| j|dd}W n& ttfk
rb t| jdd}Y nX |S )a Content of the response, in unicode.
If Response.encoding is None, encoding will be guessed using
``chardet``.
The encoding of the response content is determined based solely on HTTP
headers, following RFC 2616 to the letter. If you can take advantage of
non-HTTP knowledge to make a better guess at the encoding, you should
set ``r.encoding`` appropriately before accessing this property.
Nr5 replace)errors)r r r( r LookupErrorr )r; r r r= r= r> text> s
z
Response.textc K sj | j rZ| jrZt| jdkrZt| j}|dk rZytj| jj|f|S tk
rX Y nX tj| jf|S )zReturns the json-encoded content of a response, if any.
:param \*\*kwargs: Optional arguments that ``json.loads`` takes.
:raises ValueError: If the response body does not contain valid json.
rK N) r r rT r! r loadsrQ UnicodeDecodeErrorr )r; kwargsr r= r= r> r. d s
z
Response.jsonc C sJ | j jd}i }|rFt|}x(|D ] }|jdp8|jd}|||< q"W |S )z8Returns the parsed header links of the response, if any.linkZrelr6 )rN r r )r; r llinksr keyr= r= r> r ~ s
zResponse.linksc C s d}t | jtrDy| jjd}W qJ tk
r@ | jjd}Y qJX n| j}d| j ko^dk n rxd| j|| jf }n,d| j kodk n rd| j|| jf }|rt|| d d
S ) z2Raises stored :class:`HTTPError`, if one occurred.r5 zutf-8z
iso-8859-1i i z %s Client Error: %s for url: %siX z %s Server Error: %s for url: %s)ZresponseN)rB r r) rQ r r r6 r )r; Zhttp_error_msgr r= r= r> r s zResponse.raise_for_statusc C s0 | j s| jj t| jdd}|dk r,| dS )zReleases the connection back to the pool. Once this method has been
called the underlying ``raw`` object must not be accessed again.
*Note: Should not normally need to be called explicitly.*
release_connN)r r r r )r; r r= r= r> r s
zResponse.close)r
F) r\ r] r^ rx r rt r r r r ru r r rA r_ r r r r r r ITER_CHUNK_SIZEr r r r. r r r r= r= r= r> r B s2
/
7 & r i ( )Qrx rb r sysZencodings.idnaZ encodingsZpip._vendor.urllib3.fieldsr Z pip._vendor.urllib3.filepostr Zpip._vendor.urllib3.utilr Z pip._vendor.urllib3.exceptionsr r r r ior rg r Z
structuresr rr r
rs r r r
exceptionsr r r r r r r Z_internal_utilsr r Zutilsr r r r r r r r! r" r# compatr$ r% r& r' r( r) r* r+ r, r- r. r Z status_codesr/ ZmovedfoundotherZtemporary_redirectr r ZDEFAULT_REDIRECT_LIMITr r r r2 ra rn rv r r= r= r= r> sD $00 nF <