3
\me= @ s. d dl Z d dlZd dlZd dlZd dlZd dlmZ d dlZd dlm Z d dl
m Z d dl m
Z
d dlmZmZmZmZmZ d dlmZmZ d dlmZ d d lmZmZ d d
l m Z d d l m Z ej e!Z"d d
gZ#dZ$dZ%dZ&G dd dej'j(Z)dd Z*dd Z+G dd dej,Z-e-ej.ffgZ/dd Z0dS ) N)urlparse)ConnectionError)HTTPConnection) PoolManager)dminetsources
url_helperutil)
EventScope EventType)NoDHCPLeaseError)EphemeralDHCPv4EphemeralIPv6Network)DataSourceHostname)ProcessExecutionErrorzhttp://169.254.42.42zhttp://[fd00:42::42]
c s* e Zd ZdZ fddZdddZ ZS )SourceAddressAdapterzF
Adapter for requests to choose the local address to bind to.
c s || _ tt| jf | d S )N)source_addresssuperr __init__)selfr kwargs) __class__ (/usr/lib/python3.6/DataSourceScaleway.pyr + s z SourceAddressAdapter.__init__Fc C s0 t jtjtjdfg }t|||| j|d| _d S )N )Z num_poolsmaxsizeblockr socket_options)r Zdefault_socket_optionssocketZ
SOL_SOCKETZ SO_REUSEPORTr r Z poolmanager)r Z connectionsr r r! r r r init_poolmanager/ s z%SourceAddressAdapter.init_poolmanager)F)__name__
__module__ __qualname____doc__r r#
__classcell__r r )r r r & s r c C s` y&t j| d|d|dd d}tj|jS t jk
rZ } z|jdkrHdS W Y dd}~X nX dS )aQ
Retrieve user data or vendor data.
Scaleway user/vendor data API returns HTTP/404 if user/vendor data is not
set.
This function calls `url_helper.readurl` but instead of considering
HTTP/404 as an error that requires a retry, it considers it as empty
user/vendor data.
Also, be aware the user data/vendor API requires the source port to be
below 1024 to ensure the client is root (since non-root users can't bind
ports below 1024). If requests raises ConnectionError (EADDRINUSE), the
caller should retry to call this function on an other port.
Nr c S s |j dkot|jtjj S )Ni )code
isinstancecauserequests
exceptionsr )_excr r r W s
z%query_data_api_once..)datatimeoutretriesZsessionZ exception_cbi )r readurlr
decode_binarycontentsUrlErrorr) ) api_addressr2 requests_sessionrespr/ r r r query_data_api_once< s
r; c
C s" xt dt|dD ] }ytjd| | tj }d}yRt|j}|}|d dkr^|dd }tj |dtj
dd d } | tj krd }W n t k
r Y nX |j
d
t||fd t|||d }
tjd
| |
S tjk
r } z$tjd| | tjd | } wW Y dd} ~ X qX qW | dS )a/ Get user or vendor data.
Handle the retrying logic in case the source port is used.
Scaleway metadata service requires the source port of the client to
be a privileged port (<1024). This is done to ensure that only a
privileged user on the system can access the metadata service.
r r z*Trying to get %s data (bind on port %d)...z0.0.0.0r [N)protoz0::zhttp://)r )r2 r9 z%s-data downloadedz%Error while trying to get %s data: %s )rangemaxLOGdebugr, ZSessionr netlocr" getaddrinfo IPPROTO_TCPAF_INET6
ValueErrorZmountr r; r r7 warningtimeZsleep)
Zapi_typer8 r3 r2 Zportr9 Z localhostZ url_addressaddress
addr_protor1 r/ last_excr r r query_data_apid s>
rN c s e Zd ZdZejejejej hiZ
fddZ dd Z dd Z
edd Zd
d Zd d
Zedd Zedd Zdd Zdd Zd ddZedd Zedd Z ZS ) DataSourceScalewayScalewayc s t t| j||| tjtj|ddgi g| _t| jjdt | _
t| jjdt | _ t| jjdt
| _d | _tj| _t| _d | _d | _d | _d| _d| jj kr| j| jd 7 _d S )NZ
datasourcerP r3 r2 max_waitT
metadata_urls)r rO r r
Z
mergemanydictZget_cfg_by_pathZds_cfgintgetDEF_MD_RETRIESr3 DEF_MD_TIMEOUTr2 DEF_MD_MAX_WAITrQ _fallback_interfacer UNSET_network_config DS_BASE_URLSrR userdata_urlvendordata_urlephemeral_fixed_addresshas_ipv4keys)r Zsys_cfgdistropaths)r r r r s zDataSourceScaleway.__init__c C s| t j }tj|| j| jdd\}}|rZtjd| | d| _| d| _| d| _ dS tjd|t
t j | t dS ) zO
Define metadata_url based upon api-metadata URL availability.
F)urlsrQ r2 Zconnect_synchronouslyz%s is reachablez/conf?format=jsonz/user_data/cloud-initz/vendor_data/cloud-initNz3Unable to reach api-metadata at %s after %s seconds) rJ r Z wait_for_urlrQ r2 rB rC metadata_urlr\ r] rS r )r rc Z
start_timeZ avail_urlr. r r r _set_metadata_url s" z$DataSourceScaleway._set_metadata_urlc C sZ t j| j| j| jd}tjtj|j | _
t d| j | j| j| _
t d| j| j| j| _d S )N)r2 r3 z user-dataz vendor-data)r r4 rd r2 r3 jsonloadsr
r5 r6 metadatarN r\ Z userdata_rawr] Zvendordata_raw)r r: r r r _crawl_metadata s z"DataSourceScaleway._crawl_metadatac C s> t jd} | dkrdS tjjdr&dS tj }d|kr:dS dS )a
There are three ways to detect if you are on Scaleway:
* check DMI data: not yet implemented by Scaleway, but the check is
made to be future-proof.
* the initrd created the file /var/run/scaleway.
* "scaleway" is in the kernel cmdline.
zsystem-manufacturerrP Tz/var/run/scalewayZscalewayN)r Z
read_dmi_dataospathexistsr
Z get_cmdline)Z vendor_nameZcmdliner r r ds_detect s
z DataSourceScaleway.ds_detectc C s |dkrt jd| g S g }x|D ]~}t|j}|d dkrH|dd }tj|d tjdd d }|tjkr|dkr||g7 }q"q"|tjkr"|dkr"||g7 }q"q"W |S )
Nipv4ipv6zInvalid IP version : %sr r< r )r= )rn ro r? ) rB rC r rD r" rE rF ZAF_INETrG )r r= rc Z
filtered_urlsZurlrK rL r r r _set_urls_on_ip_version s$
z*DataSourceScaleway._set_urls_on_ip_versionc ! C s4 | j d krtj | _ | jry`t| j| j H}tjtj d| j
| j fd tjtj d| j d |d | _
d| jd< W d Q R X W n> tttfk
r } z tjtt| d| _W Y d d }~X nX | js0yVt| j| j > tjtj d | j
| j fd tjtj d| j d d
| jd< W d Q R X W n tk
r. dS X d S ) Nz3Set api-metadata URL depending on IPv4 availability)logfuncmsgfuncargszCrawl of metadata service)rq rr rs z
fixed-addressrn Z
net_in_useFz3Set api-metadata URL depending on IPv6 availabilityro T)rX r find_fallback_nicr_ r ra r
Zlog_timerB rC re rR ri r^ rh r
r r Zlogexcstrr )r rn er r r _get_data sV
z DataSourceScaleway._get_datac C s | j dkr tjdtj tj| _ | j tjkr2| j S | jdkrFtj | _| jd dkrFi }i }x| jd D ]}|d | j krd|d< dd d
g|d < qjd |j
kr|d |d d
|d f7 < n |d d
|d f|d < |d dkrj|d dd}d |j
kr |d |g7 < qj|g|d < qjW ||| j< d|d| _ ndd| j d}ddig}| jd r|dd| jd d d| jd d d d d| jd d d gd g7 }||d < d!|gd"| _ tj d#| j | j S )$z`
Configure networking according to data received from the
metadata API.
Nz5Found None as cached _network_config. Resetting to %sZ
private_ipZ
public_ipsrK TZdhcp4z169.254.42.42/32z
62.210.0.1)toviaroutesZ addresses/netmaskZfamilyZinet6gatewayz::/0)rz ry r )versionZ ethernetsZphysicalz%s)typenamer ro Zstaticz::0)Znetworkprefixr~ )r rK r} r{ subnetsr )r configznetwork_config : %s) rZ rB rI r rY rX r ru rh r^ r` rC )r ZnetcfgZip_cfgZipZrouter r r r network_configM sV
z!DataSourceScaleway.network_configc C s d S )Nr )r r r r launch_index s z DataSourceScaleway.launch_indexc C s
| j d S )Nid)rh )r r r r get_instance_id s z"DataSourceScaleway.get_instance_idc C sb dd | j d D }d}t|}x<| j jdg D ]*}|j|s@q0|j||d jdd q0W |S )Nc S s g | ] }|d qS )keyr ).0r r r r
s z:DataSourceScaleway.get_public_ssh_keys..Zssh_public_keyszAUTHORIZED_KEY=Ztagsr. )rh lenrT
startswithappendreplace)r Zssh_keysZakeypreZplentagr r r get_public_ssh_keys s
z&DataSourceScaleway.get_public_ssh_keysFc C s t | jd dS )NZhostnameF)r rh )r ZfqdnZ
resolve_ipZ
metadata_onlyr r r get_hostname s z DataSourceScaleway.get_hostnamec C s d S )Nr )r r r r availability_zone s z$DataSourceScaleway.availability_zonec C s d S )Nr )r r r r region s zDataSourceScaleway.region)FFF)r$ r% r& Zdsnamer ZNETWORKr ZBOOT_NEW_INSTANCEZBOOTZ BOOT_LEGACYZdefault_update_eventsr re ri staticmethodrm rp rx propertyr r r r r r r r( r r )r r rO s$
A M
rO c C s t j| tS )N)r Zlist_from_depends datasources)Zdependsr r r get_datasource_list s r )1rf Zloggingrj r" rJ Z urllib.parser r, Zrequests.exceptionsr Zurllib3.connectionr Zurllib3.poolmanagerr Z cloudinitr r r r r
Zcloudinit.eventr r Zcloudinit.net.dhcpr
Zcloudinit.net.ephemeralr r Zcloudinit.sourcesr Zcloudinit.subpr Z getLoggerr$ rB r[ rU rW rV ZadaptersZ HTTPAdapterr r; rN Z
DataSourcerO ZDEP_FILESYSTEMr r r r r r s8
(4 $