U
.eB @ s d dl mZ d dlZd dlZd dlZddlmZ ddlmZm Z ddlm
Z
ddl m Z m
Z
mZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZ d
ddgZeeZ dZ dZ e de Z dd Z!e"e!e e"e!e dZ#ee dZ$G dd
d
eZ%G dd de%Z&dd Z'dS ) )absolute_importN )RecentlyUsedContainer)HTTPConnectionPoolHTTPSConnectionPool)port_by_scheme)LocationValueError
MaxRetryErrorProxySchemeUnknown)six)urljoin)RequestMethods) parse_url)Retry PoolManager ProxyManagerproxy_from_url)Zkey_fileZ cert_fileZ cert_reqsZca_certsZ ssl_versionZ ca_cert_dirZ ssl_contextZ key_password)Z
key_schemeZkey_hostZkey_portZ key_timeoutZ key_retriesZ
key_strictZ key_blockZkey_source_addressZ key_key_fileZkey_key_passwordZ
key_cert_fileZ
key_cert_reqsZ key_ca_certsZkey_ssl_versionZkey_ca_cert_dirZkey_ssl_contextZ key_maxsizeZ key_headersZ
key__proxyZkey__proxy_headersZkey_socket_optionsZkey__socks_optionsZkey_assert_hostnameZkey_assert_fingerprintZkey_server_hostnamePoolKeyc C s | }|d |d< |d |d< dD ],}||kr,|| dk r,t|| ||< q,|d}|dk rxt||d< t| D ]}|||d| < q| j D ]}||krd||< q| f |S )a
Create a pool key out of a request context dictionary.
According to RFC 3986, both the scheme and host are case-insensitive.
Therefore, this function normalizes both before constructing the pool
key for an HTTPS request. If you wish to change this behaviour, provide
alternate callables to ``key_fn_by_scheme``.
:param key_class:
The class to use when constructing the key. This should be a namedtuple
with the ``scheme`` and ``host`` keys at a minimum.
:type key_class: namedtuple
:param request_context:
A dictionary-like object that contain the context for a request.
:type request_context: dict
:return: A namedtuple that can be used as a connection pool key.
:rtype: PoolKey
schemehost)headers_proxy_headersZ_socks_optionsNZsocket_optionsZkey_)
copylower frozensetitemsgettuplelistkeyspop_fields)Z key_classrequest_contextcontextkeyZ socket_optsZfield r% C/usr/lib/python3.8/site-packages/pip/_vendor/urllib3/poolmanager.py_default_key_normalizerD s
r' httphttpsc @ sx e Zd ZdZdZd ddZdd Zdd Zd d
d Zd d
Z d ddZ
dd Z d ddZ d ddZ
dd Zd!ddZdS )"r a$
Allows for arbitrary requests while transparently keeping track of
necessary connection pools for you.
:param num_pools:
Number of connection pools to cache before discarding the least
recently used pool.
:param headers:
Headers to include with all requests, unless other headers are given
explicitly.
:param \**connection_pool_kw:
Additional parameters are used to create fresh
:class:`urllib3.connectionpool.ConnectionPool` instances.
Example::
>>> manager = PoolManager(num_pools=2)
>>> r = manager.request('GET', 'http://google.com/')
>>> r = manager.request('GET', 'http://google.com/mail')
>>> r = manager.request('GET', 'http://yahoo.com/')
>>> len(manager.pools)
2
N
c K s8 t | | || _t|dd d| _t| _t | _d S )Nc S s | S N)close)pr% r% r& z&PoolManager.__init__..)Z dispose_func)r
__init__connection_pool_kwr poolspool_classes_by_schemekey_fn_by_schemer )self num_poolsr r2 r% r% r& r1 s
zPoolManager.__init__c C s | S r, r% r6 r% r% r& __enter__ s zPoolManager.__enter__c C s | dS )NF)clear)r6 exc_typeZexc_valZexc_tbr% r% r& __exit__ s zPoolManager.__exit__c C s^ | j | }|dkr | j }dD ]}||d q |dkrPtD ]}||d q>|||f|S )a
Create a new :class:`ConnectionPool` based on host, port, scheme, and
any additional pool keyword arguments.
If ``request_context`` is provided, it is provided as keyword arguments
to the pool class used. This method is used to actually create the
connection pools handed out by :meth:`connection_from_url` and
companion methods. It is intended to be overridden for customization.
N)r r portr) )r4 r2 r r SSL_KEYWORDS)r6 r r r= r" Zpool_clsr$ kwr% r% r& _new_pool s
zPoolManager._new_poolc C s | j dS )z
Empty our store of pools and direct them all to close.
This will not affect in-flight connections, but they will not be
re-used after completion.
N)r3 r: r8 r% r% r& r: s zPoolManager.clearr) c C sT |s t d| |}|p d|d< |s:t|d d}||d< ||d< | |S )a
Get a :class:`ConnectionPool` based on the host, port, and scheme.
If ``port`` isn't given, it will be derived from the ``scheme`` using
``urllib3.connectionpool.port_by_scheme``. If ``pool_kwargs`` is
provided, it is merged with the instance's ``connection_pool_kw``
variable and used to create the new connection pool, if one is
needed.
zNo host specified.r) r P r= r )r _merge_pool_kwargsr r r connection_from_context)r6 r r= r pool_kwargsr" r% r% r& connection_from_host s
z PoolManager.connection_from_hostc C s, |d }| j| }||}| j||dS )z
Get a :class:`ConnectionPool` based on the request context.
``request_context`` must at least contain the ``scheme`` key and its
value must be a key in ``key_fn_by_scheme`` instance variable.
r r" )r r5 connection_from_pool_key)r6 r" r Zpool_key_constructorpool_keyr% r% r& rC s
z#PoolManager.connection_from_contextc
C sl | j jZ | j |}|r*|W 5 Q R S |d }|d }|d }| j||||d}|| j |< W 5 Q R X |S )z
Get a :class:`ConnectionPool` based on the provided pool key.
``pool_key`` should be a namedtuple that only contains immutable
objects. At a minimum it must have the ``scheme``, ``host``, and
``port`` fields.
r r r= rF )r3 lockr r@ )r6 rH r" Zpoolr r r= r% r% r& rG s
z$PoolManager.connection_from_pool_keyc C s t |}| j|j|j|j|dS )a
Similar to :func:`urllib3.connectionpool.connection_from_url`.
If ``pool_kwargs`` is not provided and a new pool needs to be
constructed, ``self.connection_pool_kw`` is used to initialize
the :class:`urllib3.connectionpool.ConnectionPool`. If ``pool_kwargs``
is provided, it is used instead. Note that if a new pool does not
need to be created for the request, the provided ``pool_kwargs`` are
not used.
)r= r rD )r rE r r= r )r6 urlrD ur% r% r& connection_from_url s z PoolManager.connection_from_urlc C sV | j }|rR| D ]:\}}|dkrHz
||= W qP tk
rD Y qPX q|||< q|S )a
Merge a dictionary of override values for self.connection_pool_kw.
This does not modify self.connection_pool_kw and returns a new dict.
Any keys in the override dictionary with a value of ``None`` are
removed from the merged dictionary.
N)r2 r r KeyError)r6 overrideZbase_pool_kwargsr$ valuer% r% r& rB ! s
z PoolManager._merge_pool_kwargsTc K s t |}| j|j|j|jd}d|d< d|d< d|krD| j |d< | jdk rj|jdkrj|j||f|}n|j||j f|}|o|
}|s|S t ||}|j dkrd }|
d
} t| tstj| |d } | jr||stt|d }
|
D ]"} | | jkr|d | d qz| j||||d } W n$ tk
rR | jrJ | Y S X | |d
< ||d< t d
|| | j||f|S )a]
Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen`
with custom cross-host redirect logic and only sends the request-uri
portion of the ``url``.
The given ``url`` parameter must be absolute, such that an appropriate
:class:`urllib3.connectionpool.ConnectionPool` can be chosen for it.
)r= r FZassert_same_hostredirectr Nr) i/ ZGETretries)rP )responseZ_poolzRedirecting %s -> %s) r rE r r= r r r proxyurlopenZ request_uriZget_redirect_locationr Zstatusr
isinstancer Zfrom_intZremove_headers_on_redirectZ is_same_hostr r Ziterkeysr r Z incrementr Zraise_on_redirectloginfo) r6 methodrJ rP r? rK ZconnrR Zredirect_locationrQ r headerr% r% r& rT 5 sF
zPoolManager.urlopen)r+ N)N)Nr) N)N)N)T)__name__
__module__ __qualname____doc__rS r1 r9 r< r@ r: rE rC rG rL rB rT r% r% r% r& r s
c sH e Zd ZdZd fdd Zd fdd Zdd d
Zd fd d
Z ZS )r ax
Behaves just like :class:`PoolManager`, but sends all requests through
the defined proxy, using the CONNECT method for HTTPS URLs.
:param proxy_url:
The URL of the proxy to be used.
:param proxy_headers:
A dictionary containing headers that will be sent to the proxy. In case
of HTTP they are being sent with each request, while in the
HTTPS/CONNECT case they are sent only once. Could be used for proxy
authentication.
Example:
>>> proxy = urllib3.ProxyManager('http://localhost:3128/')
>>> r1 = proxy.request('GET', 'http://google.com/')
>>> r2 = proxy.request('GET', 'http://httpbin.org/')
>>> len(proxy.pools)
1
>>> r3 = proxy.request('GET', 'https://httpbin.org/')
>>> r4 = proxy.request('GET', 'https://twitter.com/')
>>> len(proxy.pools)
3
r+ Nc s t |tr d|j|j|jf }t|}|jsFt|jd}|j|d}|jdkrZt |j|| _
|pfi | _ | j
|d< | j |d< t t
| j||f| d S )Nz
%s://%s:%irA )r= r( _proxyr )rU r r r r= r r r _replacer
rS
proxy_headerssuperr r1 )r6 proxy_urlr7 r r` r2 rS r= __class__r% r& r1 s"
zProxyManager.__init__r) c sD |dkr t t| j||||dS t t| j| jj| jj| jj|dS )Nr* )rD )ra r rE rS r r= r )r6 r r= r rD rc r% r& rE s
z!ProxyManager.connection_from_hostc C s0 ddi}t |j}|r ||d< |r,|| |S )z
Sets headers needed by proxies: specifically, the Accept and Host
headers. Only sets headers not provided by the user.
ZAcceptz*/*ZHost)r netlocupdate)r6 rJ r Zheaders_re r% r% r& _set_proxy_headers s
z ProxyManager._set_proxy_headersTc sN t |}|jdkr0|d| j}| |||d< tt| j||fd|i|S )z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.r) r rP )r r r r rg ra r rT )r6 rX rJ rP r? rK r rc r% r& rT s
zProxyManager.urlopen)r+ NN)Nr) N)N)T) rZ r[ r\ r] r1 rE rg rT
__classcell__r% r% rc r& r t s
c K s t f d| i|S )Nrb )r )rJ r? r% r% r& r s )(Z
__future__r collections functoolsZlogging _collectionsr Zconnectionpoolr r r
exceptionsr r r
Zpackagesr Z packages.six.moves.urllib.parser Zrequestr
Zutil.urlr Z
util.retryr __all__Z getLoggerrZ rV r> Z _key_fields
namedtupler r' partialr5 r4 r r r r% r% r% r& s4
6
ta