3
Pf @ s~ d dl mZ d dlmZ d dlmZ d dlZd dlZd dlm Z d dlm
Z
d dl m Z d dl
mZmZmZmZmZ d d lmZmZmZmZmZmZmZmZm Z m Z d d
l m Z d d l m!Z!m"Z"m#Z#m$Z$m%Z% d d l&m'Z' d d
l(m)Z) d dl*m+Z+ d dl,m-Z- d dl.m/Z/ ej0e1Z2G dd de3Z4G dd de3Z5dd Z6G dd de5Z7G dd de5Z8G dd d e5Z9G d d d e3Z:dS ) )absolute_import) defaultdict)chainN)
pkg_resources)requests)
expanduser) is_file_url
is_dir_url
is_vcs_url url_to_path
unpack_url)
InstallationErrorBestVersionAlreadyInstalledDistributionNotFoundPreviousBuildDirError HashError
HashErrors HashUnpinnedDirectoryUrlHashUnsupportedVcsHashUnsupportedUnsupportedPythonVersion)InstallRequirement) display_pathdist_in_usersitedist_in_install_path
ensure_dirnormalize_path)
MissingHashes)
indent_log)check_dist_requires_python)vcs)Wheelc @ sD e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dS ) Requirementsc C s g | _ i | _d S )N)_keys_dict)self r& /usr/lib/python3.6/req_set.py__init__" s zRequirements.__init__c C s | j S )N)r# )r% r& r& r' keys& s zRequirements.keysc s fdd j D S )Nc s g | ]} j | qS r& )r$ ).0key)r% r& r'
* s z'Requirements.values..)r# )r% r& )r% r' values) s zRequirements.valuesc C s
|| j kS )N)r# )r% itemr& r& r' __contains__, s zRequirements.__contains__c C s$ || j kr| j j| || j|< d S )N)r# appendr$ )r% r+ valuer& r& r' __setitem__/ s
zRequirements.__setitem__c C s
| j | S )N)r$ )r% r+ r& r& r' __getitem__4 s zRequirements.__getitem__c s$ fdd j D }ddj| S )Nc s$ g | ] }d t |t | f qS )z%s: %s)repr)r* k)r% r& r' r, 8 s z)Requirements.__repr__..zRequirements({%s})z, )r) join)r% r- r& )r% r' __repr__7 s zRequirements.__repr__N)
__name__
__module__ __qualname__r( r) r- r/ r2 r3 r7 r& r& r& r' r" s r" c @ s( e Zd ZdZdd Zdd Zdd ZdS ) DistAbstractionat Abstracts out the wheel vs non-wheel prepare_files logic.
The requirements for anything installable are as follows:
- we must be able to determine the requirement name
(or we can't correctly handle the non-upgrade case).
- we must be able to generate a list of run-time dependencies
without installing any additional packages (or we would
have to either burn time by doing temporary isolated installs
or alternatively violate pips 'don't start installing unless
all requirements are available' rule - neither of which are
desirable).
- for packages with setup requirements, we must also be able
to determine their requirements without installing additional
packages (for the same reason as run-time dependencies)
- we must be able to create a Distribution object exposing the
above metadata.
c C s
|| _ d S )N)req_to_install)r% r< r& r& r' r( O s zDistAbstraction.__init__c C s t | jdS )z Return a setuptools Dist object.N)NotImplementedErrordist)r% finderr& r& r' r> R s zDistAbstraction.distc C s t | jdS )z3Ensure that we can get a Dist for this requirement.N)r= r> )r% r& r& r'
prep_for_distV s z DistAbstraction.prep_for_distN)r8 r9 r: __doc__r( r> r@ r& r& r& r' r; < s r; c C s0 | j rt| S | jr$| jjr$t| S t| S dS )zFactory to make an abstract dist object.
Preconditions: Either an editable req with a source_dir, or satisfied_by or
a wheel link, or a non-editable req with a source_dir.
:return: A concrete DistAbstraction.
N)editableIsSDistlinkis_wheelIsWheel)r< r& r& r' make_abstract_dist[ s
rG c @ s e Zd Zdd Zdd ZdS )rF c C s t tj| jjd S )Nr )listr Zfind_distributionsr<
source_dir)r% r? r& r& r' r> m s z IsWheel.distc C s d S )Nr& )r% r& r& r' r@ q s zIsWheel.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rF k s rF c @ s e Zd Zdd Zdd ZdS )rC c C s( | j j }|jdr$|j|jd |S )Nzdependency_links.txt)r< Zget_distZ has_metadataZadd_dependency_linksZget_metadata_lines)r% r? r> r& r& r' r> x s
z IsSDist.distc C s | j j | j j d S )N)r< Z run_egg_infoZ assert_source_matches_version)r% r& r& r' r@ s
zIsSDist.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rC v s rC c @ s e Zd Zdd Zdd ZdS ) Installedc C s | j jS )N)r< satisfied_by)r% r? r& r& r' r> s zInstalled.distc C s d S )Nr& )r% r& r& r' r@ s zInstalled.prep_for_distN)r8 r9 r: r> r@ r& r& r& r' rJ s rJ c @ s e Zd Zd$ddZdd Zdd Zd%d
d Zd d
Zedd Z edd Z
dd Z d&ddZ dd Z
dd Zdd Zd'd d Zd d Zd d! Zf fd"d#ZdS )(RequirementSetFNTc C s | dkrt d|| _|| _|| _|| _|| _|| _|
| _t | _ i | _
g | _ | | _ || _
g | _g | _g | _|| _| | _|| _| | _|
| _|| _|rt|}|| _|| _|| _tt | _ dS )a3 Create a RequirementSet.
:param wheel_download_dir: Where still-packed .whl files should be
written to. If None they are written to the download_dir parameter.
Separate to download_dir to permit only keeping wheel archives for
pip wheel.
:param download_dir: Where still packed archives should be written to.
If None they are not saved, and are deleted immediately after
unpacking.
:param wheel_cache: The pip wheel cache, for passing to
InstallRequirement.
Nz?RequirementSet() missing 1 required keyword argument: 'session') TypeError build_dirsrc_dir download_dirupgradeupgrade_strategyignore_installedforce_reinstallr" requirementsrequirement_aliasesunnamed_requirementsignore_dependenciesignore_requires_pythonsuccessfully_downloadedsuccessfully_installedreqs_to_cleanupas_egg
use_user_site
target_dirsession pycompileisolatedr wheel_download_dir _wheel_cacherequire_hashesr rH
_dependencies)r% rN rO rP rQ rR rS r] r_ rX rT r^ r` ra rb rc wheel_cachere rY r& r& r' r( s< zRequirementSet.__init__c C s8 dd | j j D }|jdd d djdd |D S )Nc S s g | ]}|j s|qS r& )Z
comes_from)r* reqr& r& r' r, s z*RequirementSet.__str__..c S s
| j j S )N)namelower)rh r& r& r' s z(RequirementSet.__str__..)r+ c S s g | ]}t |jqS r& )strrh )r* rh r& r& r' r, s )rU r- sortr6 )r% reqsr& r& r' __str__ s zRequirementSet.__str__c C sN dd | j j D }|jdd d djdd |D }d| jjt||f S ) Nc S s g | ]}|qS r& r& )r* rh r& r& r' r, s z+RequirementSet.__repr__..c S s
| j j S )N)ri rj )rh r& r& r' rk s z)RequirementSet.__repr__..)r+ z, c S s g | ]}t |jqS r& )rm rh )r* rh r& r& r' r, s z"<%s object; %d requirement(s): %s>)rU r- rn r6 __class__r8 len)r% ro Zreqs_strr& r& r' r7 s
zRequirementSet.__repr__c
C s |j }|j|s&tjd|j |j g S |jrV|jjrVt|jj}|j sVt
d|j | j |_ | j |_ | j
|_
| j|_|dk|_|s| jj| |gS y| j|}W n tk
r d}Y nX |dko|o|j o|j|jko|jj|jjk rt
d|||f |s8|| j|< |j |kr0|| j|j < |g}ng }|j r|jr|jr|jol|jj|jjk r| j j| t
d| d|_t t t |jj t |j|_tj!d||j |g}|}|r| j|}| j"| j| |S dS )a' Add install_req as a requirement to install.
:param parent_req_name: The name of the requirement that needed this
added. The name is used because when multiple unnamed requirements
resolve to the same name, we could otherwise end up with dependency
links that point outside the Requirements set. parent_req must
already be added. Note that None implies that this is a user
supplied requirement, vs an inferred one.
:param extras_requested: an iterable of extras used to evaluate the
environement markers.
:return: Additional requirements to scan. That is either [] if
the requirement is not applicable, or [install_req] if the
requirement is applicable and has just been added.
z6Ignoring %s: markers '%s' don't match your environmentz-%s is not a supported wheel on this platform.Nz5Double requirement given: %s (already in %s, name=%r)zhCould not satisfy constraints for '%s': installation from path or url cannot be constrained to a versionFzSetting %s extras to: %s)#ri Z
match_markersloggerwarningZmarkersrD rE r! filenameZ supportedr
r] r^ r_ ra is_directrW r0 get_requirementKeyError
constraintextrasrh Z specifierrU rj rV pathr\ tuplesortedsetuniondebugrf ) r% install_reqZparent_req_nameextras_requestedri ZwheelZ existing_reqresultZ
parent_reqr& r& r' add_requirement sp
z RequirementSet.add_requirementc C sF |j }|| jkr | j| j s>|| jkrB| j| j| j rBdS dS )NTF)rj rU ry rV )r% project_nameri r& r& r' has_requirement4 s
z RequirementSet.has_requirementc C s t dd | jj D p | jS )Nc s s | ]}|j s|V qd S )N)ry )r* rh r& r& r' ? s z2RequirementSet.has_requirements..)rH rU r- rW )r% r& r& r' has_requirements= s z RequirementSet.has_requirementsc C sD | j r@t| j | _ tjj| j r$dS tjd tdt| j dS )NTz!Could not find download directoryz0Could not find or access download directory '%s'F) rP r osr{ existsrs criticalr
r )r% r& r& r' is_downloadB s
zRequirementSet.is_downloadc C sT xB||j fD ]2}|| jkr&| j| S || jkr| j| j| S qW td| d S )NzNo project with the name %r)rj rU rV rx )r% r ri r& r& r' rw O s
z RequirementSet.get_requirementc C s4 x.| j j D ] }|jrq |j|d |j q W d S )N) auto_confirm)rU r- ry uninstallcommit_uninstall)r% r rh r& r& r' r W s
zRequirementSet.uninstallc C s | j rt| j | j| jj }| jp6tdd |D }|rJ| jrJtdg }t }xdt
||D ]V}y |j | j |||| j
d W q` tk
r } z||_|j| W Y dd}~X q`X q`W |r|dS )zY
Prepare process. Create temp directories, download and/or unpack files.
c s s | ] }|j V qd S )N)Zhas_hash_options)r* rh r& r& r' r j s z/RequirementSet.prepare_files..z--egg is not allowed with --require-hashes mode, since it delegates dependency resolution to setuptools and could thus result in installation of unhashed packages.)re rX N)rc r rW rU r- re anyr] r
r r extend
_prepare_filerX r rh r0 )r% r? Z root_reqsre Zdiscovered_reqsZ hash_errorsrh excr& r& r'
prepare_files^ s,
z RequirementSet.prepare_filesc C s | j o | jdkp | jdko |jS )NZeagerzonly-if-needed)rQ rR rv )r% rh r& r& r' _is_upgrade_allowed s
z"RequirementSet._is_upgrade_allowedc C s |j |jr| j|}d}|r| jp*|jshy|j|| W n* tk
rT d}Y n tk
rf Y nX |s| jr~t |j pt
|j s|j|_ d|_|rd}n| j dkrd}nd}|S dS dS )a Check if req_to_install should be skipped.
This will check if the req is installed, and whether we should upgrade
or reinstall it, taking into account all the relevant user options.
After calling this req_to_install will only have satisfied_by set to
None if the req_to_install is to be upgraded/reinstalled etc. Any
other value will be a dist recording the current thing installed that
satisfies the requirement.
Note that for vcs urls and the like we can't assess skipping in this
routine - we simply identify that we need to pull the thing down,
then later on it is pulled down and introspected to assess upgrade/
reinstalls etc.
:return: A text reason for why it was skipped, or None.
FTNzalready up-to-datezonly-if-neededz%not upgraded as not directly requiredzalready satisfied)
check_if_existsrK r rT rD Zfind_requirementr r r^ r r conflicts_withrR )r% r< r? Zupgrade_allowedZbest_installed skip_reasonr& r& r' _check_skip_installed s4
z$RequirementSet._check_skip_installedc ( s j s jrg S d_jr*tjd njdks8tjsJj|}jrx|dk shtdjf tjd| n<j rj j
dkrt j j }tjdt
| n tjd t jr |rtd jj jj t}|j jrjj j n0jrD|r8tjd
t}n jj t j j t j j j d r|t!d j f j"|j#| j stj }|rt$|rt% nt&|rt'|rt( j) rj* rt+ j,| d
} |r| rt- } yZj}
d} j j.r4j/r4j/}
j j.rN|
rJd} nd} t0j j |
| j1| d W nH t2j3k
r } z(tj4d| td| j f W Y dd} ~ X nX t}|j jrj j
t5j6krjj jsj jrPj7sjrDj8r&t9j p0t:j s<j_;d_n tjd |j<|}
y t=|
W nH t>k
r } z*j?rtj@|jAd n
jB W Y dd}~X nX g fdd}jCjDsވjEd |spjFr tjddj jF tGtHjFtH|
jF }x |D ]}tj@d|
| q W tGtH|
jFtHjF@ }x |
jI|D ]}|||d qZW jJjK j rj rjLjK W dQ R X S )zxPrepare a single requirements file.
:return: A list of additional InstallRequirements to also install.
Tz Obtaining %sNzP_check_skip_installed returned None but req_to_install.satisfied_by is set to %rzRequirement %s: %sfilez
Processing %sz
Collecting %szoThe editable requirement %s cannot be installed when requiring hashes, because there is no single file to hash.zSince it is already installed, we are trusting this package without checking its hash. To ensure a completely repeatable environment, install into an empty virtualenv.zsetup.pyzpip can't proceed with requirements '%s' due to a pre-existing build directory (%s). This is likely due to a previous installation that failed. pip is being responsible and not assuming it can delete this. Please delete it and try again.)Ztrust_internetF)r` hashesz4Could not install requirement %s because of error %szDCould not install requirement %s because of HTTP error %s for URL %sz.add_reqz!Installing extra requirements: %r,z"%s does not provide the extra '%s')r )Mry ZpreparedrB rs inforK AssertionErrorrS r rD schemer Zurlr r r
Zensure_has_source_dirrO Zupdate_editabler rG r@ archiverP r r rJ rN r r{ r r6 rI r Z
populate_linkr r
r r r r Z
original_linkZ is_pinnedr r r rE rc r r` r Z HTTPErrorr r Z all_schemesrQ r^ r r r r> r r rY rt argsremove_temporary_sourcer ri r rz r} r~ Zrequiresr\ r0 rZ )r% r? r< re rX r r{ Z
abstract_distrD r rP Zautodelete_unpackedr r> er Zmissing_requestedZmissingZavailable_requestedr r& )r r< r% r' r s
"
z RequirementSet._prepare_filec C s8 t jd t x| jD ] }|j qW W dQ R X dS )z Clean up files, remove builds.zCleaning up...N)rs r r r\ r )r% rh r& r& r'
cleanup_files s
z RequirementSet.cleanup_filesc s< g t fddxjj D ] }| q(W S )zCreate the installation order.
The installation order is topological - requirements are installed
before the requiring thing. We break cycles at an arbitrary point,
and make no other guarantees.
c sP | j s| krd S | jr d S j| xj| D ] }| q2W j| d S )N)rK ry addrf r0 )rh Zdep)order ordered_reqsscheduler% r& r' r s
z,RequirementSet._to_install..schedule)r~ rU r- )r% r r& )r r r r% r' _to_install s
zRequirementSet._to_installc O s | j }|r(tjddjdd |D t x|D ]}|jrltjd|j t |jdd W dQ R X y|j||f|| W n$ |jr|j r|j Y nX |jr|jr|j
|j q6W W dQ R X || _ dS ) zl
Install everything in this set (after having downloaded and unpacked
the packages)
z!Installing collected packages: %sz, c S s g | ]
}|j qS r& )ri )r* rh r& r& r' r, s z*RequirementSet.install..z Found existing installation: %sT)r N)
r rs r r6 r r r installZinstall_succeededZrollback_uninstallr r r[ )r% Zinstall_optionsZglobal_optionsr kwargsZ
to_installZ requirementr& r& r' r s:
zRequirementSet.install)FNFFNFFFNTFNNFF)NN)F)FF)r8 r9 r: r( rp r7 r r propertyr r rw r r r r r r r r r& r& r& r' rL s4
4
[
'E
rL );Z
__future__r collectionsr itertoolsr Zloggingr Z pip._vendorr r Z
pip.compatr Z pip.downloadr r r
r r Zpip.exceptionsr
r r r r r r r r r Zpip.req.req_installr Z pip.utilsr r r r r Zpip.utils.hashesr Zpip.utils.loggingr Zpip.utils.packagingr Zpip.vcsr Z pip.wheelr! Z getLoggerr8 rs objectr" r; rG rF rC rJ rL r& r& r& r' s0 0