U
f;k @ s( d Z ddlZddlZddlZddlZddlmZmZ ddlm Z
ddlm Z ddlm
Z
mZmZmZ ddlmZ ddlmZmZ dd lmZ dd
lmZmZ dd lmZ dd lm Z dd
l m Z ddl m!Z! ddl"m#Z# ddl$m%Z%m&Z& ddl'm(Z( ddl)m*Z*m+Z+m Z m,Z,m-Z-m.Z.mZm/Z/m0Z0mZ ddl1m2Z2 ddl3m4Z4 ddl5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ> W n e?k
r dd Z>Y nX ej@rddl1mAZA dZBd ZCdZDdZEz ddlFZFe! ZGeGHe7e6 W n e?k
r dZGY nX d d d d d!d"d#d$ZIG d%d& d&ZJG d'd( d(eJZKdS ))z
requests.adapters
~~~~~~~~~~~~~~~~~
This module contains the transport adapters that Requests uses to define
and maintain connections.
N)ClosedPoolErrorConnectTimeoutError) HTTPError)
InvalidHeader)LocationValueError
MaxRetryErrorNewConnectionError
ProtocolError)
ProxyError)ReadTimeoutError
ResponseError)SSLError) PoolManagerproxy_from_url)Timeout) parse_url)Retry)create_urllib3_context )_basic_auth_str)
basestringurlparse)extract_cookies_to_jar)
ConnectionErrorConnectTimeoutr InvalidProxyURL
InvalidSchema
InvalidURLr
ReadTimeout
RetryErrorr
)Response)CaseInsensitiveDict)DEFAULT_CA_BUNDLE_PATHextract_zipped_pathsget_auth_from_urlget_encoding_from_headersprepend_scheme_if_needed select_proxy
urldefragauth)SOCKSProxyManagerc O s t dd S )Nz'Missing dependencies for SOCKS support.)r )argskwargs r, B/opt/alt/python38/lib/python3.8/site-packages/requests/adapters.pyr) ? s r) )PreparedRequestF
r. zbool | str | Nonez#typing.Tuple[str, str] | str | Noner z<(typing.Dict[str, typing.Any], typing.Dict[str, typing.Any]))requestverify client_cert poolmanagerreturnc
C s i }i }t | j}|j }|j}t|di } | d}
td k oD|
} d} |dkrXd} n>|dkrn| rnt|d< n(t|t rt
j |s||d< n||d< | |d < |d k rt|t
rt|d
kr|d |d < |d
|d< n||d < ||j|d}||fS )Nconnection_pool_kw ssl_context
CERT_REQUIREDF CERT_NONETca_certs ca_cert_dir cert_reqs r cert_filer key_file)schemehostport)r urlr? lowerrA getattrget_preloaded_ssl_context
isinstancestrospathisdirtuplelenhostname)
r0 r1 r2 r3 host_params pool_kwargsZparsed_request_urlr? rA Zpoolmanager_kwargsZhas_poolmanager_ssl_contextZ should_use_default_ssl_contextr; r, r, r- _urllib3_request_contextZ s:
rQ c s2 e Zd ZdZ fddZd ddZd d
Z ZS ) BaseAdapterzThe Base Transport Adapterc s t d S N)super__init__self __class__r, r- rU s zBaseAdapter.__init__FNTc C s t dS )aC Sends PreparedRequest object. Returns Response object.
:param request: The :class:`PreparedRequest ` being sent.
:param stream: (optional) Whether to stream the request content.
:param timeout: (optional) How long to wait for the server to send
data before giving up, as a float, or a :ref:`(connect timeout,
read timeout) ` tuple.
:type timeout: float or tuple
:param verify: (optional) Either a boolean, in which case it controls whether we verify
the server's TLS certificate, or a string, in which case it must be a path
to a CA bundle to use
:param cert: (optional) Any user-provided SSL certificate to be trusted.
:param proxies: (optional) The proxies dictionary to apply to the request.
NNotImplementedError)rW r0 streamtimeoutr1 certproxiesr, r, r- send s zBaseAdapter.sendc C s t dS )z!Cleans up adapter specific items.NrZ rV r, r, r- close s zBaseAdapter.close)FNTNN)__name__
__module__ __qualname____doc__rU r` ra
__classcell__r, r, rX r- rR s
rR c s e Zd ZdZdddddgZeeeef fdd Zd d
Z d d Z
efd
dZ dd Z dd Z
dd Zd(ddZd)ddZd*ddZd d Zd d Zd d! Zd"d# Zd+d&d'Z ZS ), HTTPAdaptera The built-in HTTP Adapter for urllib3.
Provides a general-case interface for Requests sessions to contact HTTP and
HTTPS urls by implementing the Transport Adapter interface. This class will
usually be created by the :class:`Session ` class under the
covers.
:param pool_connections: The number of urllib3 connection pools to cache.
:param pool_maxsize: The maximum number of connections to save in the pool.
:param max_retries: The maximum number of retries each connection
should attempt. Note, this applies only to failed DNS lookups, socket
connections and connection timeouts, never to requests where data has
made it to the server. By default, Requests does not retry failed
connections. If you need granular control over the conditions under
which we retry a request, import urllib3's ``Retry`` class and pass
that instead.
:param pool_block: Whether the connection pool should block for connections.
Usage::
>>> import requests
>>> s = requests.Session()
>>> a = requests.adapters.HTTPAdapter(max_retries=3)
>>> s.mount('http://', a)
max_retriesconfig_pool_connections
_pool_maxsize _pool_blockc s` |t krtddd| _n t|| _i | _i | _t || _|| _ || _
| j |||d d S )Nr F)readblock) DEFAULT_RETRIESr rh from_intri
proxy_managerrT rU rj rk rl init_poolmanager)rW pool_connections pool_maxsizerh
pool_blockrX r, r- rU s
zHTTPAdapter.__init__c s fdd j D S )Nc s i | ]}|t |d qS rS )rD ).0attrrV r, r-
s z,HTTPAdapter.__getstate__..) __attrs__rV r, rV r- __getstate__ s zHTTPAdapter.__getstate__c C sD i | _ i | _| D ]\}}t| || q| j| j| j| jd d S )Nrn )rr ri itemssetattrrs rj rk rl )rW staterx valuer, r, r- __setstate__ s zHTTPAdapter.__setstate__c K s. || _ || _|| _tf |||d|| _dS )a Initializes a urllib3 PoolManager.
This method should not be called from user code, and is only
exposed for use when subclassing the
:class:`HTTPAdapter `.
:param connections: The number of urllib3 connection pools to cache.
:param maxsize: The maximum number of connections to save in the pool.
:param block: Block when no free connections are available.
:param pool_kwargs: Extra keyword arguments used to initialize the Pool Manager.
) num_poolsmaxsizero N)rj rk rl r r3 )rW connectionsr ro rP r, r, r- rs s z HTTPAdapter.init_poolmanagerc K s || j kr| j | }n|| dr^t|\}}t|f||| j| j| jd| }| j |< n4| |}t |f|| j| j| jd| }| j |< |S )a Return urllib3 ProxyManager for the given proxy.
This method should not be called from user code, and is only
exposed for use when subclassing the
:class:`HTTPAdapter `.
:param proxy: The proxy to return a urllib3 ProxyManager for.
:param proxy_kwargs: Extra keyword arguments used to configure the Proxy Manager.
:returns: ProxyManager
:rtype: urllib3.ProxyManager
socks)usernamepasswordr r ro )
proxy_headersr r ro )
rr rC
startswithr$ r) rj rk rl r r )rW proxy proxy_kwargsmanagerr r r r, r, r- proxy_manager_for
s6
z HTTPAdapter.proxy_manager_forc C s | drZ|rZd|_|dk rl|}tj|s>td| tj|sR||_ql||_ nd|_d|_d|_ |rt
|t s|d |_ |d |_
n ||_ d|_
|j rtj|j std |j |j
rtj|j
std
|j
dS ) aA Verify a SSL certificate. This method should not be called from user
code, and is only exposed for use when subclassing the
:class:`HTTPAdapter `.
:param conn: The urllib3 connection object associated with the cert.
:param url: The requested URL.
:param verify: Either a boolean, in which case it controls whether we verify
the server's TLS certificate, or a string, in which case it must be a path
to a CA bundle to use
:param cert: The SSL certificate to verify.
httpsr7 TzCCould not find a suitable TLS CA certificate bundle, invalid path: r8 Nr r z7Could not find the TLS certificate file, invalid path: z/Could not find the TLS key file, invalid path: )rC r r; rI rJ existsOSErrorrK r9 r: rG r r= r> )rW connrB r1 r^ cert_locr, r, r- cert_verify0 s8
zHTTPAdapter.cert_verifyc C s t }t|dd|_tt|di |_t|j|_||_|jj|_t |j
t r^|j
d|_
n|j
|_
t
|j|| ||_| |_|S )a Builds a :class:`Response ` object from a urllib3
response. This should not be called from user code, and is only exposed
for use when subclassing the
:class:`HTTPAdapter `
:param req: The :class:`PreparedRequest ` used to generate the response.
:param resp: The urllib3 response object.
:rtype: requests.Response
statusNheaderszutf-8)r rD status_coder! r r% encodingrawreasonrG rB bytesdecoder cookiesr0
connection)rW reqrespresponser, r, r- build_responseg s
zHTTPAdapter.build_responseNc C s t |||| jS )a Build the PoolKey attributes used by urllib3 to return a connection.
This looks at the PreparedRequest, the user-specified verify value,
and the value of the cert parameter to determine what PoolKey values
to use to select a connection from a given urllib3 Connection Pool.
The SSL related pool key arguments are not consistently set. As of
this writing, use the following to determine what keys may be in that
dictionary:
* If ``verify`` is ``True``, ``"ssl_context"`` will be set and will be the
default Requests SSL Context
* If ``verify`` is ``False``, ``"ssl_context"`` will not be set but
``"cert_reqs"`` will be set
* If ``verify`` is a string, (i.e., it is a user-specified trust bundle)
``"ca_certs"`` will be set if the string is not a directory recognized
by :py:func:`os.path.isdir`, otherwise ``"ca_certs_dir"`` will be
set.
* If ``"cert"`` is specified, ``"cert_file"`` will always be set. If
``"cert"`` is a tuple with a second item, ``"key_file"`` will also
be present
To override these settings, one may subclass this class, call this
method and use the above logic to change parameters as desired. For
example, if one wishes to use a custom :py:class:`ssl.SSLContext` one
must both set ``"ssl_context"`` and based on what else they require,
alter the other keys to ensure the desired behaviour.
:param request:
The PreparedReqest being sent over the connection.
:type request:
:class:`~requests.models.PreparedRequest`
:param verify:
Either a boolean, in which case it controls whether
we verify the server's TLS certificate, or a string, in which case it
must be a path to a CA bundle to use.
:param cert:
(optional) Any user-provided SSL certificate for client
authentication (a.k.a., mTLS). This may be a string (i.e., just
the path to a file which holds both certificate and key) or a
tuple of length 2 with the certificate file path and key file
path.
:returns:
A tuple of two dictionaries. The first is the "host parameters"
portion of the Pool Key including scheme, hostname, and port. The
second is a dictionary of SSLContext related parameters.
)rQ r3 )rW r0 r1 r^ r, r, r- $build_connection_pool_key_attributes s 0z0HTTPAdapter.build_connection_pool_key_attributesc
C s t |j|}z| |||\}}W n. tk
rP } zt||dW 5 d}~X Y nX |rt|d}t|} | jsvtd| |}
|
j
f |d|i} n| j j
f |d|i} | S )aq Returns a urllib3 connection for the given request and TLS settings.
This should not be called from user code, and is only exposed for use
when subclassing the :class:`HTTPAdapter `.
:param request:
The :class:`PreparedRequest ` object to be sent
over the connection.
:param verify:
Either a boolean, in which case it controls whether we verify the
server's TLS certificate, or a string, in which case it must be a
path to a CA bundle to use.
:param proxies:
(optional) The proxies dictionary to apply to the request.
:param cert:
(optional) Any user-provided SSL certificate to be used for client
authentication (a.k.a., mTLS).
:rtype:
urllib3.ConnectionPool
r0 NhttpFPlease check proxy URL. It is malformed and could be missing the host.rP ) r' rB r
ValueErrorr r& r r@ r r connection_from_hostr3 ) rW r0 r1 r_ r^ r rO rP e proxy_urlrr r r, r, r- get_connection_with_tls_context s8
z+HTTPAdapter.get_connection_with_tls_contextc C sp t dt t||}|rPt|d}t|}|js:td| |}| |}n t
|}| }| j |}|S )a DEPRECATED: Users should move to `get_connection_with_tls_context`
for all subclasses of HTTPAdapter using Requests>=2.32.2.
Returns a urllib3 connection for the given URL. This should not be
called from user code, and is only exposed for use when subclassing the
:class:`HTTPAdapter `.
:param url: The URL to connect to.
:param proxies: (optional) A Requests-style dictionary of proxies used on this request.
:rtype: urllib3.ConnectionPool
z`get_connection` has been deprecated in favor of `get_connection_with_tls_context`. Custom HTTPAdapter subclasses will need to migrate for Requests>=2.32.2. Please see https://github.com/psf/requests/pull/6710 for more details.r r )
warningswarnDeprecationWarningr' r& r r@ r r connection_from_urlr geturlr3 )rW rB r_ r r rr r parsedr, r, r- get_connection s$
zHTTPAdapter.get_connectionc C s& | j | j D ] }| qdS )zDisposes of any internal state.
Currently, this closes the PoolManager and any active ProxyManager,
which closes any pooled connections.
N)r3 clearrr values)rW r r, r, r- ra s
zHTTPAdapter.closec C sz t |j|}t|jj}|o"|dk}d}|rDt|j }|d}|j}|drdd|d }|rv|svt|j}|S )a? Obtain the url to use when making the final request.
If the message is being sent through a HTTP proxy, the full URL has to
be used. Otherwise, we should only use the path portion of the URL.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter `.
:param request: The :class:`PreparedRequest ` being sent.
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs.
:rtype: str
r Fr z///) r' rB r r? rC r path_urllstripr( ) rW r0 r_ r r? is_proxied_http_requestusing_socks_proxy proxy_schemerB r, r, r- request_url" s
zHTTPAdapter.request_urlc K s dS )a" Add any headers needed by the connection. As of v2.0 this does
nothing by default, but is left for overriding by users that subclass
the :class:`HTTPAdapter `.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter `.
:param request: The :class:`PreparedRequest ` to add headers to.
:param kwargs: The keyword arguments from the call to send().
Nr, )rW r0 r+ r, r, r- add_headersB s zHTTPAdapter.add_headersc C s& i }t |\}}|r"t|||d< |S )a Returns a dictionary of the headers to add to any request sent
through a proxy. This works with urllib3 magic to ensure that they are
correctly sent to the proxy, rather than in a tunnelled request if
CONNECT is being used.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter `.
:param proxy: The url of the proxy being used for this request.
:rtype: dict
zProxy-Authorization)r$ r )rW r r r r r, r, r- r P s
zHTTPAdapter.proxy_headersFTc
C s z| j ||||d}W n. tk
rD } zt||dW 5 d}~X Y nX | ||j|| | ||} | j||||||d |jdkpd|jk }
t |t
rz|\} } t | | d}W q t k
r t d| dY qX nt |t rn t ||d}z.|j
|j| |j|jd d d d | j||
d
}
W n ttfk
rV } zt||dW 5 d}~X Y nt tk
r } zt |jtrt |jtst||dt |jtrt||dt |jtrt||dt |jt rt ||dt||dW 5 d}~X Y n t k
r( } zt||dW 5 d}~X Y n tk
rR } z t|W 5 d}~X Y nx t t fk
r } zTt |t rt ||dn6t |t rt!||dn t |t"rt#||dn W 5 d}~X Y nX | $||
S ) a Sends PreparedRequest object. Returns Response object.
:param request: The :class:`PreparedRequest ` being sent.
:param stream: (optional) Whether to stream the request content.
:param timeout: (optional) How long to wait for the server to send
data before giving up, as a float, or a :ref:`(connect timeout,
read timeout) ` tuple.
:type timeout: float or tuple or urllib3 Timeout object
:param verify: (optional) Either a boolean, in which case it controls whether
we verify the server's TLS certificate, or a string, in which case it
must be a path to a CA bundle to use
:param cert: (optional) Any user-provided SSL certificate to be trusted.
:param proxies: (optional) The proxies dictionary to apply to the request.
:rtype: requests.Response
)r_ r^ r N)r\ r] r1 r^ r_ zContent-Length)connectrm zInvalid timeout za. Pass a (connect, read) timeout tuple, or a single float to set both timeouts to the same value.F) methodrB bodyr redirectassert_same_hostpreload_contentdecode_contentretriesr] chunked)%r r r r rB r r r r rG rL TimeoutSaucer urlopenr rh r r r r r r r r r r _ProxyErrorr
_SSLErrorr
r
_HTTPErrorr r _InvalidHeaderr r )rW r0 r\ r] r1 r^ r_ r r rB r r rm r errr, r, r- r` e s
zHTTPAdapter.send)N)NN)N)FNTNN)rb rc rd re rz DEFAULT_POOLSIZErp DEFAULT_POOLBLOCKrU r{ r rs r r r r r r ra r r r r` rf r, r, rX r- rg s@
&7%
2
1
)
rg )Lre os.pathrI sockettypingr Zurllib3.exceptionsr r r r r r r r r r r
r r r r
r Zurllib3.poolmanagerr r Z urllib3.utilr r r Zurllib3.util.retryr Zurllib3.util.ssl_r authr compatr r r r
exceptionsr r r r r r r modelsr
structuresr! utilsr" r# r$ r% r& r' r( Zurllib3.contrib.socksr) ImportError
TYPE_CHECKINGr. r r rp DEFAULT_POOL_TIMEOUTsslrF load_verify_locationsrQ rR rg r, r, r, r- sb 0 $
/