3
Pfp @ s d Z ddlZddlZddlZddlmZ ddlmZ ddlm Z ddl
m Z m Z m
Z
mZmZ ddlmZmZmZmZ dd lmZmZmZ dd
lmZmZ dd l m Z dd l m Z m Z dd
l!m"Z"m#Z#m$Z$m%Z% ddl&m'Z' ddl(m)Z) ddl m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0 ddl1m2Z2 ddlm3Z3 ej4 dkrXy
ej5Z6W n e7k
rT ej8Z6Y nX nejZ6e
fddZ9e
fddZ:G dd de;ZdS ) z
requests.session
~~~~~~~~~~~~~~~~
This module provides a Session object to manage and persist settings across
requests (cookies, auth, proxies).
N)Mapping) timedelta )_basic_auth_str) cookielibis_py3 OrderedDicturljoinurlparse)cookiejar_from_dictextract_cookies_to_jarRequestsCookieJar
merge_cookies)RequestPreparedRequestDEFAULT_REDIRECT_LIMIT)
default_hooks
dispatch_hook)to_native_string)to_key_val_listdefault_headers)TooManyRedirects
InvalidSchemaChunkedEncodingErrorContentDecodingError)CaseInsensitiveDict) HTTPAdapter) requote_uriget_environ_proxiesget_netrc_authshould_bypass_proxiesget_auth_from_url rewind_body
DEFAULT_PORTS)codes)REDIRECT_STATIZWindowsc C st |dkr | S | dkr|S t |to*t | ts0| S |t|}|jt| dd |j D }x|D ]
}||= qbW |S )zDetermines appropriate setting for a given request, taking into account
the explicit setting on that request, and the setting in the session. If a
setting is a dictionary, they will be merged together using `dict_class`
Nc S s g | ]\}}|d kr|qS )N ).0kvr& r& /usr/lib/python3.6/sessions.py
J s z!merge_setting..)
isinstancer r updateitems)Zrequest_settingZsession_setting
dict_classZmerged_settingZ none_keyskeyr& r& r*
merge_setting2 s
r1 c C s@ |dks|j dg kr| S | dks0| j dg kr4|S t| ||S )zProperly merges both requests and session hooks.
This is necessary because when request_hooks == {'response': []}, the
merge breaks Session hooks entirely.
Nresponse)getr1 )Z
request_hooksZ
session_hooksr/ r& r& r* merge_hooksQ s
r4 c @ s> e Zd Zdd Zdd Zddd Zd
d Zd d
Zdd ZdS )SessionRedirectMixinc C s, |j r(|jd }tr |jd}t|dS dS )z7Receives a Response. Returns a redirect URI or ``None``locationlatin1utf8N)Z is_redirectheadersr encoder )selfrespr6 r& r& r* get_redirect_targetb s
z(SessionRedirectMixin.get_redirect_targetc C s t |}t |}|j|jkr dS |jdkrL|jdkrL|jdkrL|jd krLdS |j|jk}|j|jk}tj|jddf}| r|j|kr|j|krdS |p|S )
zFDecide whether Authorization header should be removed when redirectingTZhttpP NZhttps F)r> N)r? N)r
ZhostnameschemeZportr# r3 )r; Zold_urlZnew_urlZ
old_parsedZ
new_parsedZ changed_portZchanged_schemeZ default_portr& r& r* should_strip_authx s
z&SessionRedirectMixin.should_strip_authFNTc k s. g }
| j |} x| r(|j } |
j| |
dd |_y
|j W n( tttfk
rj |jj dd Y nX t
|j| j krt d| j |d|j
| jdrt|j}
dt|
j| f } t| }|j } |jst|jt| } nt| } t| | _| j| | |jtjtjfkr>d}x |D ]}| j j |d q W d| _ | j }y
|d = W n t k
rd Y nX t | j!||j t"| j!| j# | j$| j! | j%| |}| j&| | | j'dk od |kpd |k}|rt(| | }|r|V q| j)|f|||||dd
| }t | j#| |j | j |} |V qW dS )zBReceives a Response. Returns a generator of Responses or Requests.r NF)Zdecode_contentzExceeded %s redirects.)r2 z//z%s:%sContent-Length Content-TypeTransfer-EncodingZCookie)streamtimeoutverifycertproxiesallow_redirects)rB rC rD )*r= copyappendhistorycontentr r RuntimeErrorrawreadlen
max_redirectsr close
startswithr
urlr r@ ZgeturlZnetlocr r rebuild_method status_coder$ Ztemporary_redirectZpermanent_redirectr9 popZbodyKeyErrorr Z_cookiesr cookiesZprepare_cookiesrebuild_proxies rebuild_authZ_body_positionr" send)r; r< reqrE rF rG rH rI yield_requestsZadapter_kwargsZhistrV prepared_requestZ parsed_rurlZparsedZpurged_headersheaderr9 Z
rewindabler& r& r* resolve_redirects sr
z&SessionRedirectMixin.resolve_redirectsc C sR |j }|j}d|kr*| j|jj|r*|d= | jr8t|nd}|dk rN|j| dS )zWhen being redirected we may want to strip authentication from the
request to avoid leaking credentials. This method intelligently removes
and reapplies authentication where possible to avoid credential loss.
Z
AuthorizationN)r9 rV rA request trust_envr Z prepare_auth)r; ra r2 r9 rV Znew_authr& r& r* r] s
z!SessionRedirectMixin.rebuild_authc
C s |dk r |ni }|j }|j}t|j}|j }|jd}t||d}| jr~| r~t||d} | j|| jd}
|
r~|j ||
d|kr|d= yt
|| \} } W n t k
r d\} } Y nX | r| rt | | |d< |S )a This method re-evaluates the proxy configuration by considering the
environment variables. If we are redirected to a URL covered by
NO_PROXY, we strip the proxy configuration. Otherwise, we set missing
proxy keys for this URL (in case they were stripped by a previous
redirect).
This method also replaces the Proxy-Authorization header where
necessary.
:rtype: dict
Nno_proxy)rf allzProxy-Authorization)NN)
r9 rV r
r@ rK r3 r re r
setdefaultr! rZ r )
r; ra rI r9 rV r@ Z new_proxiesrf Z bypass_proxyZenviron_proxiesproxyZusernameZpasswordr& r& r* r\ s*
z$SessionRedirectMixin.rebuild_proxiesc C sX |j }|jtjkr |dkr d}|jtjkr6|dkr6d}|jtjkrN|dkrNd}||_ dS )zWhen being redirected we may want to change the method of the request
based on certain specs or browser behavior.
HEADGETPOSTN)methodrX r$ Z see_otherfoundZmoved)r; ra r2 rm r& r& r* rW : s z#SessionRedirectMixin.rebuild_method)FNTNNF) __name__
__module__ __qualname__r= rA rc r] r\ rW r& r& r& r* r5 ` s
k)r5 c @ s e Zd ZdZdddddddd d
d d d
dg
Zdd Zdd Zdd Zdd Zd7ddZ dd Z
d d Z d d Z d8d!d"Z
d9d#d$Zd:d%d&Zd'd( Zd)d* Zd+d, Zd-d. Zd/d0 Zd1d2 Zd3d4 Zd5d6 ZdS );Sessiona~ A Requests session.
Provides cookie persistence, connection-pooling, and configuration.
Basic Usage::
>>> import requests
>>> s = requests.Session()
>>> s.get('http://httpbin.org/get')
Or as a context manager::
>>> with requests.Session() as s:
>>> s.get('http://httpbin.org/get')
r9 r[ authrI hooksparamsrG rH ZprefetchadaptersrE re rS c C sr t | _d | _i | _t | _i | _d| _d| _d | _ t
| _ d| _ t
i | _t | _| jdt | jdt d S )NFTzhttps://zhttp://)r r9 rs rI r rt ru rE rG rH r rS re r r[ r rv mountr )r; r& r& r* __init__j s
zSession.__init__c C s | S )Nr& )r; r& r& r* __enter__ s zSession.__enter__c G s | j d S )N)rT )r; argsr& r& r* __exit__ s zSession.__exit__c
C s |j pi }t|tjs t|}ttt | j |}|j}| jrV| rV| j rVt |j
}t }|j |j
j |j
|j|j|jt|j| jtdt|j| jt|| j|t|j| jd
|S )a Constructs a :class:`PreparedRequest ` for
transmission and returns it. The :class:`PreparedRequest` has settings
merged from the :class:`Request ` instance and those of the
:class:`Session`.
:param request: :class:`Request` instance to prepare with this
session's settings.
:rtype: requests.PreparedRequest
)r/ )
rm rV filesdatajsonr9 ru rs r[ rt )r[ r, r Z CookieJarr r r
rs re r rV r Zpreparerm upperr| r} r~ r1 r9 r ru r4 rt )r; rd r[ Zmerged_cookiesrs pr& r& r* prepare_request s*
zSession.prepare_requestNTc C st t |j ||||pi ||p i ||| d
}| j|}| p8i } | j|j| |
||}| |
d}|j| | j|f|}|S )a Constructs a :class:`Request `, prepares it and sends it.
Returns :class:`Response ` object.
:param method: method for the new :class:`Request` object.
:param url: URL for the new :class:`Request` object.
:param params: (optional) Dictionary or bytes to be sent in the query
string for the :class:`Request`.
:param data: (optional) Dictionary, bytes, or file-like object to send
in the body of the :class:`Request`.
:param json: (optional) json to send in the body of the
:class:`Request`.
:param headers: (optional) Dictionary of HTTP Headers to send with the
:class:`Request`.
:param cookies: (optional) Dict or CookieJar object to send with the
:class:`Request`.
:param files: (optional) Dictionary of ``'filename': file-like-objects``
for multipart encoding upload.
:param auth: (optional) Auth tuple or callable to enable
Basic/Digest/Custom HTTP Auth.
:param timeout: (optional) How long to wait for the server to send
data before giving up, as a float, or a :ref:`(connect timeout,
read timeout) ` tuple.
:type timeout: float or tuple
:param allow_redirects: (optional) Set to True by default.
:type allow_redirects: bool
:param proxies: (optional) Dictionary mapping protocol or protocol and
hostname to the URL of the proxy.
:param stream: (optional) whether to immediately download the response
content. Defaults to ``False``.
:param verify: (optional) Either a boolean, in which case it controls whether we verify
the server's TLS certificate, or a string, in which case it must be a path
to a CA bundle to use. Defaults to ``True``.
:param cert: (optional) if String, path to ssl client cert file (.pem).
If Tuple, ('cert', 'key') pair.
:rtype: requests.Response
)
rm rV r9 r| r} r~ ru rs r[ rt )rF rJ )r r r merge_environment_settingsrV r- r^ )r; rm rV ru r} r9 r[ r| rs rF rJ rI rt rE rG rH r~ r_ ZprepZsettingsZ send_kwargsr< r& r& r* rd s( )
zSession.requestc K s |j dd | jd|f|S )zSends a GET request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
rJ Trk )rh rd )r; rV kwargsr& r& r* r3 s z Session.getc K s |j dd | jd|f|S )zSends a OPTIONS request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
rJ TZOPTIONS)rh rd )r; rV r r& r& r* options! s zSession.optionsc K s |j dd | jd|f|S )zSends a HEAD request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
rJ Frj )rh rd )r; rV r r& r& r* head, s z Session.headc K s | j d|f||d|S )a Sends a POST request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`.
:param json: (optional) json to send in the body of the :class:`Request`.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
rl )r} r~ )rd )r; rV r} r~ r r& r& r* post7 s
z Session.postc K s | j d|fd|i|S )aY Sends a PUT request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
ZPUTr} )rd )r; rV r} r r& r& r* putC s z Session.putc K s | j d|fd|i|S )a[ Sends a PATCH request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
ZPATCHr} )rd )r; rV r} r r& r& r* patchN s z
Session.patchc K s | j d|f|S )zSends a DELETE request. Returns :class:`Response` object.
:param url: URL for the new :class:`Request` object.
:param \*\*kwargs: Optional arguments that ``request`` takes.
:rtype: requests.Response
ZDELETE)rd )r; rV r r& r& r* deleteY s zSession.deletec
K s~ |j d| j |j d| j |j d| j |j d| j t|trJtd|jdd}|j d}|j
}| j |j d}t
}|j|f|}t
| } t| d |_td
||f|}|jrx |jD ]}
t| j|
j|
j qW t| j||j | j||f|} |r
d d | D ng } | r.| jd
| | j }| |_|sny"t| j||fddi||_W n tk
rl Y nX |sz|j |S )zISend a given PreparedRequest.
:rtype: requests.Response
rE rG rH rI z#You can only send PreparedRequests.rJ T)rV )Zsecondsr2 c S s g | ]}|qS r& r& )r' r< r& r& r* r+ s z Session.send..r r` ) rh rE rG rH rI r, r
ValueErrorrY r3 rt get_adapterrV preferred_clockr^ r elapsedr rM r r[ rd rP rc insertnextZ_next
StopIterationrN )
r; rd r rJ rE rt adapterstartrr r< genrM r& r& r* r^ c sB
"z Session.sendc
C s | j rr|dk r|jdnd}t||d}x |j D ]\}} |j|| q2W |dksZ|dkrrtjjdpptjjd}t|| j}t|| j }t|| j
}t|| j }||||dS )z^
Check the environment and merge it with some settings.
:rtype: dict
Nrf )rf TZREQUESTS_CA_BUNDLEZCURL_CA_BUNDLE)rG rI rE rH ) re r3 r r. rh osenvironr1 rI rE rG rH )
r; rV rI rE rG rH rf Z env_proxiesr( r) r& r& r* r s z"Session.merge_environment_settingsc C s: x(| j j D ]\}}|j j|r |S q W td| dS )z~
Returns the appropriate connection adapter for the given URL.
:rtype: requests.adapters.BaseAdapter
z*No connection adapters were found for '%s'N)rv r. lowerrU r )r; rV prefixr r& r& r* r s zSession.get_adapterc C s x| j j D ] }|j q W dS )z+Closes all adapters and as such the sessionN)rv valuesrT )r; r) r& r& r* rT s z
Session.closec sB || j < fdd| j D }x |D ]}| j j|| j |< q$W dS )zwRegisters a connection adapter to a prefix.
Adapters are sorted in descending order by prefix length.
c s g | ]}t |t k r|qS r& )rR )r' r( )r r& r* r+ s z!Session.mount..N)rv rY )r; r r Z keys_to_mover0 r& )r r* rw s
z
Session.mountc s t fdd jD }|S )Nc 3 s | ]}|t |d fV qd S )N)getattr)r' attr)r; r& r* s z'Session.__getstate__..)dict __attrs__)r; stater& )r; r* __getstate__ s zSession.__getstate__c C s& x |j D ]\}}t| || q
W d S )N)r. setattr)r; r r valuer& r& r* __setstate__ s zSession.__setstate__)NNNNNNNTNNNNNN)NN)N)N)ro rp rq __doc__r rx ry r{ r rd r3 r r r r r r r^ r r rT rw r r r& r& r& r* rr Q s2
7)
D
I rr c C s t S )zQ
Returns a :class:`Session` for context-management.
:rtype: Session
)rr r& r& r& r* session s r )?r r platformZtime collectionsr Zdatetimer rs r compatr r r r r
r[ r r r
r Zmodelsr r r rt r r Z_internal_utilsr Zutilsr r
exceptionsr r r r Z
structuresr rv r r r r r r! r" r# Z status_codesr$ r% systemZ perf_counterr AttributeErrorZclockr1 r4 objectr5 rr r r& r& r& r* sB $
r "