R`i Z d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl m
Z
ddlmZmZ ddlmZ ddlmZ ddlmZmZmZmZ dd lmZmZm Z m Z m Z m Z dd
lm Z! dd lm"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z( dd l)m*Z* dd
l+m,Z,m-Z-m.Z.m/Z/ ddl0m1Z1 dZ2 ejf Z4dddZ5djm ejn d ed d Z8ejr dk( rd Z:d Z"d Z;d Zd Z?ej d ZAd! ZBd" ZCd# ZDd$ ZEdHd%ZFd& ZGd' ZHd( ZId) ZJd* ZKd+ ZLd, ZMd- ZN eOd. ZPd/ ZQd0 ZRd1 ZSd2 ZTd3 ZUd4 ZVej d5 ZWd6 ZXdId7ZYd8 ZZdJd9Z[dKd:Z\d; Z]d< Z^d=j d> Z`e`d?z Zae`d@z ZbdA ZcdB ZddC ZedD ZfdE ZgdF ZhdG Ziy)Lz
requests.utils
~~~~~~~~~~~~~~
This module provides utility functions that are used within Requests
that are also useful for external consumption.
N) OrderedDict) make_headers parse_url )certs __version__)_HEADER_VALIDATORS_BYTE_HEADER_VALIDATORS_STRHEADER_VALIDATORSto_native_string)Mapping
basestringbytes
getproxiesgetproxies_environment
integer_types)parse_http_list) proxy_bypassproxy_bypass_environmentquotestrunquoteurlparse
urlunparsecookiejar_from_dict)FileModeWarning
InvalidHeader
InvalidURLUnrewindableBodyError)CaseInsensitiveDict)z.netrc_netrcP i )httphttpsz, z,\s*T)accept_encodingzaccept-encodingwin32c dd l } |j |j d }t |j |d d }|j |d d }|r|sy|j d }|D ]j }|dk( rd| vr y |j dd
}|j d d }|j d
d }t j || t j sj y y# t $ r Y yw xY w# t t f$ r Y yw xY w)Nr Fz;Software\Microsoft\Windows\CurrentVersion\Internet Settings ProxyEnable
ProxyOverride;z.Tz\.*z.*?)
winreg ImportErrorOpenKeyHKEY_CURRENT_USERint QueryValueExOSError
ValueErrorsplitreplacerematchI)hostr0 internetSettings proxyEnable
proxyOverridetests /builddir/build/BUILDROOT/alt-python312-pip-23.3.1-3.el8.x86_64/opt/alt/python312/lib/python3.12/site-packages/pip/_vendor/requests/utils.pyproxy_bypass_registryrC L s
%~~((N
f 1 12BM RST UVK " / /0@/ RST UM -
&++C0
!Dy d? <<U+D<<U+D<<T*DxxdBDD) " ? $ s# C AC+ C('C(+C=<C=c B t r t | S t | S )zReturn True, if the host should be bypassed.
Checks proxy settings gathered from the environment, if specified,
or the registry.
)r r rC )r= s rB r r p s " #+D1 1(. . c > t | d r| j } | S )z/Returns an internal sequence dictionary update.items)hasattrrG )ds rB dict_to_sequencerJ | s q'
GGI HrE c d }d}t | d r t | }n~t | d r
| j }net | d rY | j }t j | j
}d| j vrt j dt t | d rW | j }t | d r:|8 | j dd | j }| j |xs d |d}t! d||z
S # t j t f$ r Y w xY w# t $ r d}Y ?w xY w# t $ r ||}Y Rw xY w)
Nr __len__lenfilenoba% Requests has determined the content-length for this request using the binary size of the file: however, the file has been opened in text mode (i.e. without the 'b' flag in the mode). This may lead to an incorrect content-length. In Requests 3.0, support will be removed for files in text mode.tellseek )rH rM rN osfstatst_sizemodewarningswarnr ioUnsupportedOperationAttributeErrorrP rQ r6 max)o total_lengthcurrent_positionrN s rB super_lenr` s] Lq) 1v E uu H XXZF 88F+33L !&&
2 $
q& % vvx q&!l&: %FF1aL#$668L FF+0q1 q,!11 22e '' 8
X %#$L%% 0
'#/
0s6 D (E 7D0 D-,D-0 D>=D>
EEc | t j j d }||f}n
d t D } ddlm}m} d}|D ]E } t j j | }t j j | sC|} n |yt | } d}
t | t r|
j d }
| j j |
d } || j! | } | r| d rdnd}
| |
| d fS y# t $ r Y yw xY w# |t" f$ r |r Y yw xY w# t$ t& f$ r Y yw xY w)
z;Returns the Requests tuple auth for a given url from netrc.NETRCNc 3 & K | ] }d | yw)z~/N ).0fs rB z!get_netrc_auth.. s 9[Rs8[s r )NetrcParseErrornetrc :asciir rR )rS environget NETRC_FILESri rh path
expanduserKeyErrorexistsr
isinstancer decodenetlocr8 authenticatorsr6 r1 r[ )url raise_errors
netrc_filenetrc_locationsrh ri
netrc_pathrf locrisplitstrr= r# login_is rB get_netrc_authr sS (J %-9[9-
0
A
gg((+ ww~~c"
!
c] c3 w/Hyyx(+
:&55d;F %ay!a w33 3
: )
(
s` D) D# D) D) A D) +D DD) DD) D&#D) %D&&D) )D;:D;c t | dd }|rBt |t r1|d dk7 r(|d dk7 r t j j | S yyyy)z0Tries to guess the filename of the given object.nameNr <>)getattrrs r rS ro basename)objr s rB guess_filenamer sT 3 %D
4,aC DHPSOww %% ET ,trE c R t j j | r| S t j j | \ }}|ryt j j | sZt j j | \ }}|sn5dj ||g }|r t j j | sZt j | s| S t j | }||j vr| S t j }t j j ||j d d }t j j | s6t | 5 }|j |j | ddd |S |S # 1 sw Y |S xY w)zReplace nonexistent paths that look like they refer to a member of a zip
archive with the location of an extracted copy of the target, or else
just return the provided path unchanged.
/r N)rS ro rr r8 joinzipfile
is_zipfileZipFilenamelisttempfile
gettempdir atomic_openwriteread)ro archivememberprefixzip_filetmpextracted_path file_handlers rB extract_zipped_pathsr s@
ww~~d ggmmD)OGV
"''..1 ''--0
66*+
"''..1 g & w'H
X&&((
CWW\\#v||C'8'<=N
77>>. )
(L x}}V 4 5 ) > ) s /!F F&c # J K t j t j j | \ }} t j
|d 5 }| ddd t j || y# 1 sw Y xY w# t $ r t j | w xY ww)z-Write a file to the disk in an atomic fashion)dirwbN) r mkstemprS ro dirnamefdopenr9
BaseExceptionremove)filenametmp_descriptortmp_name tmp_handlers rB r r , s ( / /BGGOOH4M N NH
YY~t
, -
8X& -
,
(
s4 7B#B A4 B 3B#4A=9B B B#c t | yt | t t t t f r t d t
| S )a Take an object and test to see if it can be represented as a
dictionary. Unless it can not be represented as such, return an
OrderedDict, e.g.,
::
>>> from_key_val_list([('key', 'val')])
OrderedDict([('key', 'val')])
>>> from_key_val_list('string')
Traceback (most recent call last):
...
ValueError: cannot encode objects that are not 2-tuples
>>> from_key_val_list({'key': 'val'})
OrderedDict([('key', 'val')])
:rtype: OrderedDict
N+cannot encode objects that are not 2-tuples)rs r r boolr4 r7 r values rB from_key_val_listr 9 s6 $
}%#udC01FGG u rE c | yt | t t t t f r t d t | t r| j } t | S )a Take an object and test to see if it can be represented as a
dictionary. If it can be, return a list of tuples, e.g.,
::
>>> to_key_val_list([('key', 'val')])
[('key', 'val')]
>>> to_key_val_list({'key': 'val'})
[('key', 'val')]
>>> to_key_val_list('string')
Traceback (most recent call last):
...
ValueError: cannot encode objects that are not 2-tuples
:rtype: list
Nr ) rs r r r r4 r7 r rG listr s rB to_key_val_listr T sJ "
}%#udC01FGG%!
;rE c g }t | D ]5 }|dd |dd cxk( rdk( rn nt |dd }|j | 7 |S )a Parse lists as described by RFC 2068 Section 2.
In particular, parse comma-separated lists where the elements of
the list may include quoted-strings. A quoted-string could
contain a comma. A non-quoted string could have quotes in the
middle. Quotes are removed automatically after parsing.
It basically works like :func:`parse_set_header` just that items
may appear multiple times and case sensitivity is preserved.
The return value is a standard :class:`list`:
>>> parse_list_header('token, "quoted value"')
['token', 'quoted value']
To create a header from the :class:`list` again, use the
:func:`dump_header` function.
:param value: a string with a list header.
:return: :class:`list`
:rtype: list
Nr r ")_parse_list_headerunquote_header_valueappend)r resultitems rB parse_list_headerr r sT . F"5) 8tBCy 'C ''Qr
3D
d * MrE c i }t | D ]H }d|vrd||<
|j dd \ }} | dd | dd cxk( rdk( rn nt | dd } | ||< J |S )a^ Parse lists of key, value pairs as described by RFC 2068 Section 2 and
convert them into a python dict:
>>> d = parse_dict_header('foo="is a fish", bar="as well"')
>>> type(d) is dict
True
>>> sorted(d.items())
[('bar', 'as well'), ('foo', 'is a fish')]
If there is no value for a key it will be `None`:
>>> parse_dict_header('key_without_value')
{'key_without_value': None}
To create a header from the :class:`dict` again, use the
:func:`dump_header` function.
:param value: a string with a dict header.
:return: :class:`dict`
:rtype: dict
=Nr r r )r r8 r )r r r r s rB parse_dict_headerr sx , F"5) d? F4L jja( e !9bc
)c )(q5E t * MrE c | rF| d | d cxk( rdk( r5n | S | dd } |r| dd dk7 r"| j dd j d d S | S )
zUnquotes a header value. (Reversal of :func:`quote_header_value`).
This does not use the real unquoting but what browsers are actually
using for quoting.
:param value: the header value to unquote.
:rtype: str
r r r r NrR z\\\z\")r9 )r is_filenames rB r r sd
qU2Y-#- L a eBQi6 1==.66ucB B LrE c J i }| D ] }|j ||j < |S )zReturns a key/value dictionary from a CookieJar.
:param cj: CookieJar object to extract cookies from.
:rtype: dict
)r r )cj cookie_dictcookies rB dict_from_cookiejarr s- K#)<< FKK rE c t || S )zReturns a CookieJar from a key/value dictionary.
:param cj: CookieJar to insert cookies into.
:param cookie_dict: Dict of key/values to insert into CookieJar.
:rtype: CookieJar
r )r r s rB add_dict_to_cookiejarr s {B //rE c ^ t j dt t j dt j
}t j dt j
}t j d }|j
| |j
| z |j
| z S )zlReturns encodings from given content string.
:param content: bytestring to extract encodings from.
zIn requests 3.0, get_encodings_from_content will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)z!])flagsz+]z$^<\?xml.*?encoding=["\']*(.+?)["\'>])rW rX DeprecationWarningr: compiler< findall)content
charset_re pragma_rexml_res rB get_encodings_from_contentr s
MM
1
@MJ
IQSQUQUVI
ZZ?
@F 7#
G
$ %
..
! "rE c H | j d }|d j |dd }}i }d}|D ]m }|j }|s|d}}|j d } | dk7 r+|d| j | }|| dz d j | }|||j < o ||fS ) zReturns content type and parameters from given header
:param header: string
:return: tuple containing content type and dictionary of
parameters
r, r r Nz"' Tr r )r8 stripfindlower)
headertokens content_typeparams params_dictitems_to_stripparamkeyr index_of_equalss
rB _parse_content_type_headerr s \\#
F!!9??,fQRj&LKN
C #jjoO "$ ,_-33NC o 1 34::>J',K $ $$rE c | j d }|syt | \ }}d|v r|d j d S d|v ryd|v ryy) z}Returns encodings from given HTTP Header Dict.
:param headers: dictionary to extract encoding from.
:rtype: str
z content-typeNcharsetz'"textz
ISO-8859-1zapplication/jsonutf-8)rm r r )headersr r s rB get_encoding_from_headersr s` ;;~.L 5lCL&Fi &&u--
\) *rE c # K |j | E d{ y t j |j d }| D ] }|j | }|s| |j dd }|r| yy7 ew)zStream decodes an iterator.Nr9 errorsrE T)final)encodingcodecsgetincrementaldecoderrt )iteratorrdecoderchunkrvs rB stream_decode_response_unicoder 3 s zz6f**1::6iHG
^^E
"
H
4 (B
s A<A:AA<"A<c # K d}||dk r t | }|t | k r | |||z ||z
}|t | k r yyw)z Iterate over slices of a string.r N)rM )string slice_lengthposs rB iter_slicesr D sW
C|q 06{
F
S3 -.. | F
s A AAc > t j dt g }t | j }|r t | j | S t | j |d S # t $ r |j | Y 5w xY w# t $ r | j cY S w xY w)zReturns the requested content back in unicode.
:param r: Response object to get unicode content from.
Tried:
1. charset from content-type
2. fall back and replace all unicode characters
:rtype: str
zIn requests 3.0, get_unicode_from_response will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)r9 r )
rW rX r r r r r UnicodeErrorr TypeError)r tried_encodingsr s rB get_unicode_from_responser N s
MM
1
O )3H -qyy(+ +
199hy99 - " "8 , - yys# A$ B $B BB B zBABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789-._~c | j d }t dt | D ]l }|| dd }t | dk( rI|j r9 t t |d }|t v r||| dd z ||< Vd|| ||< bd|| ||< n d j | S # t $ r t d| d w xY w)
zUn-escape any percent-escape sequences in a URI that are unreserved
characters. This leaves all reserved, illegal and non-ASCII bytes encoded.
:rtype: str
%r r rR z"Invalid percent-escape sequence: ''N )
r8 rangerM isalnumchrr4 r7 r UNRESERVED_SETr )uripartsihcs rB unquote_unreservedr { s
IIcNE
1c%j
! !HQqM q6Q;199;
LAr
O N" uQx|+a uQxj>a58*~E!H " 775>
L #EaS!JKK
Ls B''C c p d}d} t t | | S # t $ r t | | cY S w xY w)zRe-quote the given URI.
This function passes the given URI through an unquote/quote cycle to
ensure that it is fully and consistently quoted.
:rtype: str
z!#$%&'()*+,/:;=?@[]~z!#$&'()*+,/:;=?@[]~)safe)r r r )r safe_with_percentsafe_without_percents rB requote_urir sJ /0 5 ',3DEE 5 S 344 5s 55c
r t j dt j | d }|j d \ }}t j dt j t t
| d }t j dt j | d |z }||z ||z k( S )zThis function allows you to check if an IP belongs to a network subnet
Example: returns True if ip = 192.168.1.1 and net = 192.168.1.0/24
returns False if ip = 192.168.1.1 and net = 192.168.100.0/24
:rtype: bool
z=Lr r )structunpacksocket inet_atonr8 dotted_netmaskr4 )ipnetipaddrnetaddrbitsnetmasknetworks rB address_in_networkr s ]]4!1!1"!5
6q
9FIIcNMGTmmD&"2"2>#d)3L"MNqQGmmD&"2"27";I)r inet_ntoar pack)maskr s rB r r s7 b4i 1, ,D FKKd 3 44rE c N t j | y# t $ r Y yw xY w)z
:rtype: bool
FT)r r r6 ) string_ips rB is_ipv4_addressr& s. # s $$c | j d dk( rR t | j d d }|dk s|dkD ry t j
| j d d yy# t $ r Y yw xY w# t $ r Y yw xY w)zV
Very simple check of the cidr format in no_proxy variable.
:rtype: bool
r r Fr r T)countr4 r8 r7 r r r6 )string_networkr# s rB
is_valid_cidrr* s C A% ~++C034D !8tby ^ 1 1# 6q 9 :
s" A( 'A7 ( A43A47 BBc # 8 K |du}|r2t j j | }|t j | < d |r(t j | = y|t j | < yy# |r(t j | = w |t j | < w w xY ww)zSet the environment variable 'env_name' to 'value'
Save previous value, yield, and then restore the previous value stored in
the environment variable 'env_name'.
If 'value' is None, do nothingN)rS rl rm )env_namer
value_changed old_values rB set_environr/ s %MJJNN8, $
8 1
JJx('0
8$ = JJx('0
8$ s 9BA+ +B+,BBc d }|}| |d }t | }|j y|rd |j dd j d D }t |j r=|D ]7 }t | rt
|j | s% y|j |k( s7 y n_|j }|j r|d |j z
}|D ]0 }|j j | s|j | s0 y t d| 5 t |j }ddd ryy
# t t j f$ r d
}Y )w xY w# 1 sw Y .xY w) zL
Returns whether we should bypass proxies or not.
:rtype: bool
c t j j | xs- t j j | j S N)rS rl rm upper)r s rB get_proxyz(should_bypass_proxies..get_proxy s- zz~~c"AbjjnnSYY[&AArE Nno_proxyTc 3 & K | ] }|s| y wr2 rd )re r= s rB rg z(should_bypass_proxies.. s R%ITTD%Is r ,:F)r hostnamer9 r8 r& r* r portendswithr/ r r r gaierror) rw r5 r4 no_proxy_argparsedproxy_iphost_with_portr= bypasss rB should_bypass_proxiesrC sI B
L Z(
c]F
SX%5%5c2%>%D%DS%IR 6?? + $ *)&//8D #__0 % $__N{{ Afkk]"33 ??++D1^5L5LT5R !
Z . !&//2F
/
6??+ F
/ .s* ED22E
EEEE c 4 t | | ri S t S )zA
Return a dict of environment proxies.
:rtype: dict
r5 )rC r )rw r5 s rB get_environ_proxiesrF 8 s S84 |rE c . |xs i }t | }|j +|j |j |j d S |j dz |j z |j d|j z dg}d}|D ] }||v s|| } |S |S )zSelect a proxy for the url, if applicable.
:param url: The url being for the request
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs
Nallz://zall://)r r: rm scheme)rw proxiesurlparts
proxy_keysproxy proxy_keys rB select_proxyrO D s mG}H {{8??GKK,>?? % ("3"338$$$
J
E I&E L
LrE c 8 ||ni }| j }t | j }|j d }|j }|rOt || sBt
|| }|j ||j d }|r|j || |S )a This method takes proxy information from a request and configuration
input to resolve a mapping of target proxies. This will consider settings
such a NO_PROXY to strip proxy configurations.
:param request: Request or PreparedRequest
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs
:param trust_env: Boolean declaring whether to trust environment configs
:rtype: dict
r5 rE rH )rw r rI rm copyrC rF
setdefault) requestrJ trust_envrw rI r5 new_proxiesenviron_proxiesrM s rB resolve_proxiesrW ^ s !,g"G
++C
c]
!
!F{{:&H,,.K.sXF-cHE ##FO,?,?,FG " "65 1 rE c | dt S )zO
Return a string representing the default user agent.
:rtype: str
r r )r s rB default_user_agentrY y s V1[M ""rE c : t t t ddd S )z9
:rtype: requests.structures.CaseInsensitiveDict
z*/*z
keep-alive)z
User-AgentzAccept-EncodingAccept
Connection)r" rY DEFAULT_ACCEPT_ENCODINGrd rE rB default_headersr^ s% ,. 6&
rE c g }d}| j | } | s|S t j d| D ] } |j dd \ }}d|j d i}|j d D ]: } |j d \ }} | j | ||j | < < |j | |S # t $ r |d}}Y w xY w# t $ r Y 4w xY w) zReturn a list of parsed link headers proxies.
i.e. Link: ; rel=front; type="image/jpeg",; rel=back;type="image/jpeg"
:rtype: list
z '"z, * '"r )r r: r8 r7 r ) r links
replace_charsvalrw r linkr r s rB parse_header_linksrd s
EM KK
&E xx& " ))C+KC syy*+\\#&E
"[[ -
U .3[[ -GD=) *
' T! '$ L " rC "
s# B?1C?
CC C C rk rR c | dd }|t j t j fv ry|dd t j k( ry|dd t j t j
fv ry|j
t }|dk( ry |dk( r |ddd t k( ry
|d dd t k( ry |dk( r|dd t k( ry
|d d t k( ryy)z
:rtype: str
N zutf-32rf z utf-8-sigrR zutf-16r r z utf-16-ber z utf-16-lez utf-32-bez utf-32-le)
r BOM_UTF32_LE BOM_UTF32_BEBOM_UTF8 BOM_UTF16_LE BOM_UTF16_BEr( _null_null2_null3)datasample nullcounts rB guess_json_utfrt s "1XF
&%%v':':;;
bqzV__$
bqzf))6+>+>?? U#IA~A~ #A#;& !$Q$<6 ! A~ "1: !": rE c t | }|\ }}}}}}} |j }
|
s||
}}
|rdj ||
g }
||}|d}t ||
|d|| f S )zGiven a URL that may or may not have a scheme, prepend the given scheme.
Does not replace a present scheme with the one provided as an argument.
:rtype: str
@r )r ru r r ) rw
new_schemer? rI authr= r; ro queryfragmentru s rB prepend_scheme_if_neededr{ s{ s^F6<3FD$dE8 ]]F V 4.)
~ | vvtRA BBrE c t | } t |j t |j f}|S # t t
f$ r d}Y |S w xY w)z{Given a url with authentication components, extract them into a tuple of
username,password.
:rtype: (str,str)
)r r )r r usernamepasswordr[ r )rw r? rx s rB get_auth_from_urlr sU c]F('&//*BC K
I & Ks *9 A
Ac B | \ }}t | |d t | |d y)zVerifies that header parts don't contain leading whitespace
reserved characters, or return characters.
:param header: tuple, in the format (name, value).
r r N)_validate_header_part)r r r s rB check_header_validityr s% KD%&$*&%+rE c
t |t r
t | }n7t |t r
t | }n t d|d| dt
| |j | s|dk( rdnd}t d| d| y ) Nz
Header part (z) from z# must be of type str or bytes, not r r r zSInvalid leading whitespace, reserved character(s), or returncharacter(s) in header z: )rs r r r r
r typer; )r header_partheader_validator_index validator header_kinds rB r r s +s#*+AB K '+,BC K?'& :115k1B0C
E
??; ' 6! ;f &&1]"[O
E
(rE c ~ t | \ }}}}}}|s||}}|j dd d }t |||||df S )zW
Given a url remove the fragment and the authentication part.
:rtype: str
rv r r r )r rsplitr )rw rI ru ro r ry rz s rB
urldefragauthr & sU 5=SM1FFD&% V
]]3
"2
&F vvtVUB? @@rE c t | j dd }|.t | j t r || j yt
d # t
$ r t
d w xY w)zfMove file pointer back to its recorded starting position
so it can be read again on redirect.
rQ Nz;An error occurred when rewinding request body for redirect.z+Unable to rewind request body for redirect.)r bodyrs _body_positionr r6 r! )prepared_request body_seeks rB rewind_bodyr 7 st (--vtr s
# < $ : ) ," $ c*
)) BHHWl489JKL
<<7"H /
?3D6
r&"J 6< @ F2 02%22" $P M
05, 5 50 1 1*9x 46# "L
g @C:
,
&A"SrE