U
.eEQ @ s d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl m
Z
d dl m Z m
Z
d dlmZ d dlmZ d dlmZmZ d dlmZ d d lmZ d d
lmZ d d l m Z d d l m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' d d
l(m)Z) d dl*m+Z+ d dl,m-Z- d dl.m/Z/ d dl0m1Z1 d dl2m3Z3 e+rd dl4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z: d dl;mZ> d dl?m@Z@ d dlAmBZB ered0d ZSd1d2 ZTd3d4 ZUd?d5d ZVd@d6d!ZWd7d# ZXd8d" ZYd9d: ZZd;d< Z[dS )A )absolute_importN)requests)CONTENT_CHUNK_SIZEResponse)PY2)parse) HashMismatchInstallationError)PyPI)
PipSession) auto_decode) copy2_fixed) ask_path_exists
backup_dirconsume display_path format_sizehide_urlpath_to_displayrmtreesplitext)
TempDirectory)MYPY_CHECK_RUNNING)DownloadProgressProvider) unpack_file)get_url_scheme)vcs)IOCallableListOptionalTextTuple) TypedDict)Link)Hashes)VersionControlCopytreeKwargsignoresymlinksF)Ztotal)
copy_functionr) Zignore_dangling_symlinksr* get_file_contentunpack_vcs_linkunpack_file_urlunpack_http_url
unpack_urlparse_content_dispositionsanitize_content_filenamec
C s6 |dkrt dt| }|dkr>|| }| |j|jfS |dkr|rd|drdtd|| f | ddd }| d d
}t
|}|r| dd |d dd }t
|}|d
rd
|d
}|} z&t| d }t| }W 5 Q R X W n4 tk
r, } ztd
t| W 5 d} ~ X Y nX | |fS )a* Gets the content of a file; it may be a filename, file: URL, or
http: URL. Returns (location, content). Content is unicode.
:param url: File path or url.
:param comes_from: Origin description of requirements.
:param session: Instance of pip.download.PipSession.
NzAget_file_content() missing 1 required keyword argument: 'session')httpZhttpsfiler3 z6Requirements file %s references URL %s, which is local: \/|rbz$Could not open requirements file: %s) TypeErrorr getraise_for_statusurltext
startswithr splitreplace_url_slash_drive_rematchgroup urllib_parseZunquotelstripopenr readIOErrorstr)
r> Z
comes_fromsessionschemeresppathrD fZcontentexc rR :/usr/lib/python3.8/site-packages/pip/_internal/download.pyr, U sB
z /*([a-z])\|c C s, t | }|d k st|j|t| jd d S )N)r> )_get_used_vcs_backendAssertionErrorunpackr r> )linklocation vcs_backendrR rR rS r- s c C s$ t jD ]}| j|jkr| S qdS )z1
Return a VersionControl object or None.
N)r ZbackendsrM Zschemes)rW rY rR rR rS rT s
rT c O s | S NrR )iterableargskwargsrR rR rS _progress_indicator s r^ c
s6 zt jd }W n tttfk
r0 d}Y nX tdd}t tj krRd}n&|r\d}n |dkrjd}n|std}nd}|j
}fdd} fd d
}
t } |j t
j kr|} n|j} |rt||d } |rtd | t| n td
| n |rtd| n td
| |
| | tt}
|r*||
nt|
d S )Nzcontent-lengthr Z
from_cacheFi@ Tc 3 sT z j j| ddD ]
}|V qW n. tk
rN j | }|sBqJ|V q0Y nX d S )NF)Zdecode_content)rawstreamAttributeErrorrI )Z
chunk_sizechunk)rN rR rS resp_read s
z _download_url..resp_readc 3 s | D ]} | |V qd S rZ )write)Zchunksrb ) content_filerR rS written_chunks s
z%_download_url..written_chunks)maxzDownloading %s (%s)zDownloading %szUsing cached %s)intheaders
ValueErrorKeyErrorr; getattrloggerZgetEffectiveLevelloggingINFOshow_urlr^ Znetlocr
Zurl_without_fragmentr infor r Zcheck_against_chunksr )rN rW re hashes progress_barZ total_lengthZ cached_respZ
show_progressrp rc rf Zprogress_indicatorr> Zdownloaded_chunksrR )re rN rS
_download_url sP
% rt c C s d}t j||j}t j|rtdt| d}|dkr@d}nj|dkrdtdt| t | nF|dkrt
|}td t|t| t || n|d
krt
d |rt | | td t| d S )
NTz8The file %s exists. (i)gnore, (w)ipe, (b)ackup, (a)abort)iwbaru Frv z Deleting %srw zBacking up %s to %srx zSaved %s)osrO joinfilenameexistsr r rm warningremover shutilZmovesysexitcopyrq )r| rX rW r Zdownload_locationresponseZ dest_filerR rR rS
_copy_file s6
r onc
C s |d krt dtddv}d }|r0t| ||}|rH|}t|d } nt| ||j||\}} t||| |r~|s~t||| |st
| W 5 Q R X d S )Nz@unpack_http_url() missing 1 required keyword argument: 'session'rV )Zkindr ) r; r _check_download_dir mimetypes
guess_type_download_http_urlrO r r rz unlink)
rW rX download_dirrL rr rs temp_diralready_downloaded_path from_path content_typerR rR rS r/ s2 c
C sT zt | | W n@ tjk
rN } z tdt|t| t| W 5 d}~X Y nX dS )zCopying special files is not supported, but as a convenience to users
we skip errors copying them. This supports tools that may create e.g.
socket files in the project source directory.
z>Ignoring special file error '%s' encountered copying %s to %s.N)r
r ZSpecialFileErrorrm r~ rK r )srcdesterR rR rS _copy2_ignoring_special_filesJ s r c s` t j|}t j|t j| fdd}t|dd}tsLt|d< tj |f| d S )Nc s6 g }| kr|ddg7 }t j| kr2|g7 }|S )Nz.toxz.nox)rz rO abspath)dnamesZskippedsourceZtarget_basenameZtarget_dirnamerR rS r) e s
z!_copy_source_tree..ignoreTr( r+ )
rz rO r basenamedirnamedictr r r Zcopytree)r targetZtarget_abspathr) r] rR r rS _copy_source_tree_ s r c C s | j }| r>tj|r"t| t|| |r:td dS |rL| | d}|r`t
| ||}|rj|}n|}t |d }t
||| |r|st||| dS )zUnpack link into location.
If download_dir is provided and link points to a file, make a copy
of the link file inside download_dir.
z*Link is a directory, ignoring download_dirNr ) file_pathZis_existing_dirrz rO isdirr r rm rq check_against_pathr r r r r )rW rX r rr Z link_pathr r r rR rR rS r. ~ s.
c C sP | j rt| | n:| jr*t| |||d n"|dkr8t }t| |||||d dS )av Unpack link.
If link is a VCS link:
if only_download, export into download_dir and ignore location
else unpack into location
for other types of link:
- unpack into location
- if download_dir, copy the file into download_dir
- if only_download, mark location for deletion
:param hashes: A Hashes object, one of whose embedded hashes must match,
or HashMismatch will be raised. If the Hashes is empty, no matches are
required, and unhashable types of requirements (like VCS ones, which
would ordinarily raise HashUnsupported) are allowed.
)rr N)rr rs )Zis_vcsr- is_filer. r r/ )rW rX r rL rr rs rR rR rS r0 s c C s t j| S )zJ
Sanitize the "filename" value from a Content-Disposition header.
)rz rO r )r| rR rR rS r2 s c C s, t | \}}|d}|r$t|}|p*|S )z
Parse the "filename" value from a Content-Disposition header, and
return the default filename if the result is empty.
r| )cgiZ parse_headerr< r2 )content_dispositionZdefault_filenameZ_typeZparamsr| rR rR rS r1 s
c
C s* | j ddd }z |j|ddidd}| W n8 tjk
rj } ztd|jj | W 5 d }~X Y nX |j
d
d }| j } |j
d }
|
rt |
| } t
| d } | st|} | r| | 7 } | s| j |j krtj
|j d } | r| | 7 } tj|| } t| d
}
t|| |
|| W 5 Q R X | |fS )z6Download link url into temp_dir using provided session#r6 r zAccept-EncodingZidentityT)ri r` z HTTP error %s while getting %sNz content-type zcontent-dispositionwb)r> rA r< r= r Z HTTPErrorrm Zcriticalr Z status_coderi r| r1 r r Zguess_extensionrz rO r{ rH rt )rW rL r rr rs Z
target_urlrN rQ r r| r Zextr re rR rR rS r sB
r c C sp t j|| j}t j|s dS td| |rlz|| W n, tk
rj t d| t
| Y dS X |S )z Check download_dir for previously downloaded file with correct hash
If a correct file is found return its path else None
Nz File was already downloaded %sz;Previously-downloaded file %s has bad hash. Re-downloading.) rz rO r{ r| r} rm rq r r r~ r )rW r rr Z
download_pathrR rR rS r 7 s
r )NN)NNNr )NN)NNNr )\Z
__future__r r rn r rz rer r Z pip._vendorr Zpip._vendor.requests.modelsr r Zpip._vendor.sixr Z pip._vendor.six.moves.urllibr rF Zpip._internal.exceptionsr r Zpip._internal.models.indexr
Z pip._internal.network.sessionr Z pip._internal.utils.encodingr Z pip._internal.utils.filesystemr
Zpip._internal.utils.miscr r r r r r r r r Z pip._internal.utils.temp_dirr Zpip._internal.utils.typingr Zpip._internal.utils.uir Z pip._internal.utils.unpackingr Zpip._internal.utils.urlsr Zpip._internal.vcsr typingr r r r r! r" Zmypy_extensionsr# Zpip._internal.models.linkr$ Zpip._internal.utils.hashesr% Z pip._internal.vcs.versioncontrolr& rK boolr' __all__Z getLogger__name__rm r, compileIrC r- rT r^ rt r r/ r r r. r0 r2 r1 r r rR rR rR rS s ,
0 d
-"
8
.?