3
\me< @ s d dl Z d dlZd dlZd dlZd dlmZmZmZ d dlm Z d dl
m Z ej e
ZdZd%d&d'd(d)gZG dd dejZG dd deZdd Zdd Zdd ZddeddfddZdd ZG d d d eZG d d d eZeej ffeej ej ffgZ d d! Z e
d"krd#d$ Z e dS )* N)sources
url_helperutil)KlibcNetworkConfigSource)NetworkConfigSourcez
2012-03-01meta-data/instance-idFmeta-data/local-hostnamemeta-data/public-keysTmeta-data/vendor-data vendor-data user-datac @ s` e Zd ZdZdZdZdZdd Zedd Z dd Z
d
d Z d d
Z dd Z
dd Zdd ZdS )DataSourceMAASz
DataSourceMAAS reads instance information from MAAS.
Given a config metadata_url, and oauth tokens, it expects to find
files under the root named:
instance-id
user-data
hostname
vendor-data
MAASNc C s: t jj| ||| d | _tjj|jd| _t| j | _
d S )NZmaas) r
DataSource__init__base_urlospathjoinseed_dirget_id_from_ds_cfgds_cfgid_hash)selfsys_cfgZdistropaths r $/usr/lib/python3.6/DataSourceMAAS.pyr . s zDataSourceMAAS.__init__c C s | j st| j| _ | j S )N)
_oauth_helperget_oauth_helperr )r r r r oauth_helper4 s zDataSourceMAAS.oauth_helperc C s t jj| }d|| jf S )Nz%s [%s])r r __str__r )r rootr r r r! : s zDataSourceMAAS.__str__c C s | j }y| j| jt| j dS tk
r2 Y n4 tk
rd } ztjd| j| W Y d d }~X nX |jdd }|szdS y0| j |sdS | j|t
|| j j | j
dd dS tk
r tjtd| dS X d S )NTz%s was malformed: %s metadata_urlF )read_file_or_urlr retriesz$Failed fetching metadata from url %s)r _set_datar read_maas_seed_dirMAASSeedDirNoneMAASSeedDirMalformedLOGwarninggetwait_for_metadata_serviceread_maas_seed_urlr readurlr Exceptionr logexc)r mcfgexcurlr r r _get_data> s4
zDataSourceMAAS._get_datac C sp || _ |\}}}|| _|| _|| _|rlytj|| _W n4 tk
rj } ztj d| d | _W Y d d }~X nX d S )Nz"Invalid content in vendor-data: %s)
r Z userdata_rawmetadataZvendordata_purer Zconvert_vendordataZvendordata_raw
ValueErrorr+ r, )r r5 dataZudmdvder r r r' e s
zDataSourceMAAS._set_datac C s
d| j S )z/Return the subplatform metadata source details.z
seed-dir (%s))r )r r r r _get_subplatforms s z DataSourceMAAS._get_subplatformc C s
| j }d}yt|jd|}W n" tk
r@ tjtd| Y nX |dkrNdS d}y ||krlt|jd|}W n tk
r tjd| Y nX tj }|j d r|d d }d |t
f }|g}| j j |||d \}}|rtj
d
| ntjd|ttj | t|S )Nx max_waitz Failed to get max wait. using %sr F2 timeoutz Failed to get timeout, using %s/r$ z%s/%s/meta-data/instance-id)urlsr? rA zUsing metadata source: '%s'z(Giving up on md from %s after %i seconds)r intr- r1 r r2 r+ r, timeendswith
MD_VERSIONr Z wait_for_urldebugZcriticalbool) r r5 r3 r? rA Z starttimeZ check_urlrC Z _responser r r r. w s8
z(DataSourceMAAS.wait_for_metadata_servicec C s0 | j dkrdS tj|d| jfi }| j t|kS )a locally check if the current system is the same instance.
MAAS doesn't provide a real instance-id, and if it did, it is
still only available over the network. We need to check based
only on local resources. So compute a hash based on Oauth tokens.NF
datasource)r r Zget_cfg_by_pathdsnamer )r r Zncfgr r r check_instance_id s
z DataSourceMAAS.check_instance_id)__name__
__module__ __qualname____doc__rL r r r propertyr r! r6 r' r= r. rM r r r r r
s '&r
c s0 e Zd ZejejejejfZ fddZ Z
S )DataSourceMAASLocalc s, t j stjd dS tjd t j S )Nz No initramfs applicable configFz!Found initramfs applicable config)r Z
is_applicabler+ rI superr6 )r ) __class__r r r6 s
z DataSourceMAASLocal._get_data) rN rO rP r ZCMD_LINEZ
SYSTEM_CFGZDSZ INITRAMFSZnetwork_config_sourcesr6
__classcell__r r )rU r rS s
rS c s& d}t fdd|D }tjf |S )zReturn an oauth helper instance for values in cfg.
@raises ValueError from OauthUrlHelper if some required fields have
true-ish values but others do not. consumer_keyconsumer_secret token_key token_secretc s g | ]}| j |fqS r )r- ).0r)cfgr r
s z$get_oauth_helper..)rW rX rY rZ )dictr ZOauthUrlHelper)r] keyskwargsr )r] r r s r c s4 d }dj fdd|D }dtj|jdj S )
z;Given a config, generate a unique identifier for this node.rW rY rZ c s g | ]} j |d qS ) )r- )r[ f)r r r r^ s z&get_id_from_ds_cfg..zv1:zutf-8)rW rY rZ )r hashlibZsha256encodeZ hexdigest)r ZfieldsZidstrr )r r r s r c C sN | j dr| dd } tjj| s6ttj| dkr>tdtd| d dS )Nzfile:// r z%s: not a directoryz file://%s)version)
startswithr r isdirlenlistdirr) r/ )Zseed_dr r r r( s
r( c C s |dkrt j}| jdr$| dd
} i }xtD ]\}}} }
|dkrPd| |f } nd| ||f } yXtj|} || ||| d}
|
j r| r|
j||< qtj|
j||< nt j
d| |
j W q. t j k
r } z:|j dkr|
rt
d ||f |n|j dkr |W Y dd}~X q.X q.W t|| S ) a
Read the maas datasource at seed_url.
read_file_or_url is a method that should provide an interface
like util.read_file_or_url
Expected format of seed_url is are the following files:
* //meta-data/instance-id
* //meta-data/local-hostname
* //user-data
If version is None, then / will not be used.
NrB r$ z%s/%sz%s/%s/%s)r& rA ssl_detailsz4Fetching from %s resulted in an invalid http code %si zMissing required %s: %srD )r r% rG DS_FIELDSr Zfetch_ssl_detailsokcontentsZ
decode_binaryr+ r, codeZUrlErrorr* check_seed_contents)Zseed_urlr% rA rh r r& r: r Z _dictnameZbinaryoptionalr5 rm Zrespr< r r r r/ s:
r/ c
C s i }g }xrt D ]j\}}}}|| kr2|s|j| qd|krl|jd\}} }
||krZi ||< | | || |
< q| | ||< qW t|dkrtd| |rtd||f d} |jdrt } tj |jd| td} | | krtd|jd |jd
| fS ) zValidate if dictionary content valid as a return for a datasource.
Either return a (userdata, metadata, vendordata) tuple or
Raise MAASSeedDirMalformed or MAASSeedDirNone
rB r z%s: no data files foundz%s: missing files %sNz vendor-data)defaultZallowedz%vendor-data was not loadable as yaml.z user-dataz meta-data)
rn append partitionrk r) r* r- objectr Z load_yaml)
ZcontentZseedretZmissingZspathZdpathZ_binaryrs top_pZvd_dataerrr r r rr s2
rr c @ s e Zd ZdS )r) N)rN rO rP r r r r r) 9 s r) c @ s e Zd ZdS )r* N)rN rO rP r r r r r* = s r* c C s t j| tS )N)r Zlist_from_depends datasources)Zdependsr r r get_datasource_listI s r~ __main__c s. ddl } ddl}ddl}| jdd}|jddddd |jd d
d dd |jd d
d
dd |jddddd |jddddd |jdddtd |jddd}x0dCD ](\}}|j||d }|jd!d"d#dd$ qW |j }|j |j
|j |j d%} |j
dkrJxNdDD ]F}
d(|
d) } tjj| r tj| tjr |jjd*| | |_
q W |j
rtj|j
} d+| krt| d+ d, } x6| j D ]*}
|
| kr~| |
dkr~| |
| |
< q~W |jdkrd-| kr| d- |_|jdkr|jjd. |jd/ t| fd0d1fd2d3 fd4d5 |jd kr|jjd6|j j }|jd d7ks`|jj d8rrt |j\}}}nt |j|j |d9d:\}}}t!d; t!|dkrd |j|dkrd.geturlc s t d| | j f d S )Nz == %s ==
%s
)printdecode)r5 )r r r printurl s zmain..printurlc sx | j drlxh| j j D ]J}|j dr< d| |f q |dkrV d| df q d| |f q W n| d S )NrB z%s%sz meta-dataz
meta-data/)rG r
splitlines)r5 line)r r r r r r s
zmain..crawlzChecking seed at %s
rB zfile:// )rh r% r& z=== user-data ===zN/Az=== meta-data ===z=== vendor-data ===z%s/r r r- r r r )r r r )r r )$argparsepprintsysArgumentParser add_argumentrH Zadd_subparsersZ
add_parser
parse_argsZckeyZtkeyZtsecZcsecconfigr r existsaccessR_OKstderrwriter Z read_confr` r5 exitr r r0 ri r( r/ Zapiverr r rG )r r r parserZsubcmdsnamer r{ argsZcredsZfnameZfpathr] r r0 Zuserdatar7 r; r )r r r r r mainO s
r )r r FF)r r FF)r r FT)r
r TT)r r TT)!re Zloggingr rF Z cloudinitr r r Zcloudinit.net.cmdliner Zcloudinit.sourcesr Z getLoggerrN r+ rH rn r r
rS r r r( r/ rr r1 r) r* ZDEP_FILESYSTEMZ DEP_NETWORKr} r~ r r r r r sD
4'