3
\me @ s` d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m
Z
d dl m Z d dl m Z d dl m
Z
d dl mZ d dl mZ d d l mZ d d
l mZ d d l mZ d d l mZ d d
lmZ d dlmZ d dlmZ d dlmZ d dl m Z m Z m Z m Z m!Z!m"Z" d dl#m$Z$ d dl%m&Z& d dl'm(Z(m)Z)m*Z*m+Z+ dZ,dZ-e(e)e*dZ.ej/e0Z1dJddZ2dd Z3dKd d Z4d d Z5d!d" Z6ed#d$d%Z7d&d' Z8dMd*d+Z9dNee:e;f d-d.d/Zd4d5 Z?d6d7 Z@d8d9 ZAd:d; ZBdOdd?d@ZEdAdB ZFdCdD ZGdPdEdFZHe0dGkr\dHejIkrBdIejIdH< eHejJZKeKr\ejLeK dS )Q N)Tuple)netinfo)signal_handler)sources)stages)
url_helper)util)version)warnings) reporting)
atomic_helper)read_cfg_paths)cc_set_hostname)Modules)validate_cloudconfig_schema) LogExportersetup_basic_logging
setup_logging
reset_loggingconfigure_root_logger
DEPRECATED)events)load) PER_INSTANCE
PER_ALWAYSPER_ONCE CLOUD_CONFIGzOCloud-init v. {version} running '{action}' at {timestamp}. Up {uptime} seconds.zcloud_%s_modules)instancealwaysonce c C s^ | rt jjd| t jjdd t jjd tjt jd t jjdd t jjd d S )Nz%s
-<
)file)sysstderrwrite traceback print_exc)msg r+ /usr/lib/python3.6/main.pyr) H s r) c C s t j r tj } tjd| d S )Nz PID [%s] started cloud-init.)r Zis_LinuxosgetppidLOGinfo)Zppidr+ r+ r, log_ppidR s r1 c C s, |s t | }tjd| ddtd t |S )Nz%s
FT)Zconsoler& log)welcome_formatr Z multi_logr/ r1 )actionr* r+ r+ r, welcomeX s
r5 c C s t jtj tj tj | dS )N)r uptimeZ timestampr4 )WELCOME_MSG_TPLformatr version_stringr r6 Z time_rfc2822)r4 r+ r+ r, r3 ` s
r3 c C s2 g }| j r.x"| j D ]}|jtjj|j qW |S )N)filesappendr- pathrealpathname)argsZfn_cfgsZfhr+ r+ r, extract_fnsi s
r@ )modsc C sv t | }| j|\}}t|t| }|dkrXd||f }tjjd| tj| g S tjdt|t| |S d S )Nr z)No '%s' modules to run under section '%s'z%s
z Ran %s modules with %s failures)MOD_SECTION_TPLZ run_sectionlenr% r& r' r/ debug)rA action_nameZsectionZfull_section_name which_ranfailuresZtotal_attemptedr* r+ r+ r, run_module_sectionv s
rH c C s | j drtj| j d d S )Nr )getr Zupdate_configuration)cfgr+ r+ r, apply_reporting_cfg s
rK cloud-config-urlurlc C s@ t j| }x |D ]}||kr||| fS qW td| |f d S )Nz!No keys (%s) found in string '%s')r Zkeyval_str_to_dictKeyError)cmdlinenamesdatakeyr+ r+ r, parse_cmdline_url s
rS T)returnc C s( |dkrt j }yt|\}}W n tk
r: tjdfS X |jd }|rtjj | r|rxd| |f }tj
}|rtj}nd| |f }tj }||fS |ddd d
}|s|rtj }d |d < ntj}d
|d < d} d}
yt j
f |} d} | j rd }
t| t jrDy | t| jt|
d7 } W n tk
r0 Y nX | j|
sVd}
n| jj|
sVd}
|
r|dkrttt jdddd dfS n0|dkrtj }ntj
}|d| dt|
fS n|d|| jf fS | | j } W n0 t jk
r } z|d||f fS d}~X nX t j| | d d tj
d ||| f fS ) a Write data from url referenced in command line to path.
path: a file to write content to if downloaded.
network: should network access be assumed.
cmdline: the cmdline to parse for cloud-config-url.
This is used in MAAS datasource, in "ephemeral" (read-only root)
environment where the instance netboots to iscsi ro root.
and the entity that controls the pxe config has to configure
the maas datasource.
An attempt is made on network urls even in local datasource
for case of network set up in initramfs.
Return value is a tuple of a logger function (logging.DEBUG)
and a message indicating what happened.
Nz!No kernel command line url found.file:///z_file '%s' existed, possibly from local stage download of command line url '%s'. Not re-writing.zafile '%s' existed, possibly from previous boot download of command line url '%s'. Not re-writing.
T)rM ZtimeoutZretriesstream Z sec_betweeng?s
#cloud-config )Z
chunk_sizeFrM z!The kernel command line key `url`z22.3zD Please use `cloud-config-url` kernel command line parameter instead)Z
deprecatedZdeprecated_versionZ
extra_messageZ
return_logzcloud-config-urlz
contents of 'z' did not start with z$url '%s' returned code %s. Ignoring.z retrieving url '%s' failed: %si )modez*wrote cloud-config data from %s='%s' to %s)rU rV ) r Z get_cmdlinerS rN loggingDEBUG
startswithr- r< existsINFOWARNr Zread_file_or_urlok
isinstanceZ UrlResponsenextZ iter_contentrC
StopIterationcontentsr strZ deprecatecodeZUrlError
write_file)r< networkrO Z cmdline_namerM Z
path_is_localmlevelkwargsrQ headerZrespZsniffed_contentZ is_cloud_cfger+ r+ r, attempt_cmdline_url s
rq c C s dt jjt jjf }tjj| jjdd}tjj |rlt
|j }||krt j
d | jd tj|| n*tjj | jjdrt jd tj|| dS ) zPurge the cache if python version changed on us.
There could be changes not represented in our cache (obj.pkl) after we
upgrade to a new version of python, so at that point clear the cache
z%d.%drQ zpython-versionz-Python version change detected. Purging cacheTZobj_pklzMWriting python-version file. Cache compatibility status is currently unknown.N)r% version_infomajorminorr- r< joinpaths get_cpathr` openreadr/ rD purge_cacher rj
get_ipath_curr0 )initZcurrent_python_versionZpython_version_pathZcached_python_versionr+ r+ r, $purge_cache_on_python_version_change s
r} c C s t j| jdrdS |j S )NZdisable_network_activationF)r get_cfg_option_boolrJ local)r| r? r+ r+ r, _should_bring_up_interfaces& s r c - C s t jt jg}|jrt jg}ttjjdt d|j dg}|jsJt | }n t d| }t
j ||j d}|j
t| d }d }y.|jtjdf tj tj|j| \}}W n< tk
r d}tjt| t| |jtj|f Y nX |jr tjd t t |j t |j t | |d x |D ]\} }tj | | q&W y |j! W n" tk
rn tjtd
Y nX |j"}
t#| |jrt j$nt j%} | t j%krd } t&j'j(d t)j* nZd
} tj+|jdd}
|
rtjd d } n(|
j,d}tjj-|r
tjd| d } |j. t/||}yB|j0| d | t j%kr\|j1j2| kr\tjd| |j1 d g fS W n t j3k
r | t j$krtjd n tjtd |j4s|j5|d tjd| | t j$krd g fS d dgfS n tjd| Y nX t6| |j7 }tjd| | ||j8 | t j$kr(t9|d d d |j5|d | t j$krx|j1j2| krhtjd | |j1 |j1g fS tjd | |j1 |j: |j; t9|d!d"d y2|j< j=d#|j>t?gt?d$\}}|s|j>t@ W n* tk
r tjtd% |j1d%gfS X |j"j,d&}tjj-|r r? ZdepsZ
early_logsw_msgr| ZoutfmtZerrfmtr* ZlvlZ path_helperr\ r ZmcfgZmfileZbring_up_interfacesZiidZranZ_resultsZcloud_cfg_pathrA Z outfmt_origZ errfmt_origr+ r+ r, main_init, s
r c C s d|krt jd d S |d }|d kr4t jd d S t|tsNt jd| d S |jd}|d krnt jd d S t|tst jd| d S | jjdd }|j t
j r|t t
j d }nt jd
| | ||krt jd | || d S t
jd ||t|d
d S )NZ di_reportz no di_report found in config.zdi_report was None.z%di_report config not a dictionary: %sZdatasource_listz(no 'datasource_list' found in di_report.z(di_report/datasource_list not a list: %s.rX z1Datasource '%s' came from unexpected module '%s'.z:used datasource '%s' from '%s' was in di_report's list: %sZdsid_missing_source)sourcedslist)r/ rD rd dictr rI list
__module__
rpartitionr_ r Z DS_PREFIXrC r
Z show_warningrh )r rJ Zdicfgr modnamer+ r+ r, r sB
r c C s( |j }td| |f }tjg |jd}|jt| y|jdd W n> tj k
r d| }t
j t | t
| |js~|gS Y nX t| t|t||jd}y$t jd t
j t
j|j| W n tk
r t
j t d Y nX |jrt jd t t|j t|j t||d
t|||S ) Nz%s:%s)r r r )r zGCan not apply stage %s, no datasource found! Likely bad things to come!)r z
Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r* )r\ r3 r r r r r@ r r r r r r/ r) r r r rD r r rJ r r r rK r5 rH )rE r? r> r r| r* rA r+ r+ r, main_modules> s:
r c
C s |j }t| }tjg |jd}|jt| y|jdd W n4 tj k
rp t
j t d t
d |jsldS Y nX t| t|t||jd}|j}|rt jd| |j}|rt jd| tj|}y$t jd t
j t
j|jd W n" tk
r
t
j t d
Y nX |jr$t jd t t|j t |j t | |d |j |||\}} | rlt j d
| dS |st j d| dS dS d S )N)r r r )r z;Failed to fetch your datasource, likely bad things to come!rZ )r z Using passed in arguments %sz Using passed in frequency %sz
Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r* zRan %s but it failed!z Did not run %s, does it exist?r ) r> r3 r r r r r@ r r r r r r/ r) r r r module_argsrD Z frequencyFREQ_SHORT_NAMESrI r r rJ r r r rK r5 Z
run_singler )
r> r? Zmod_namer r| rA Zmod_argsZmod_freqrF rG r+ r+ r, main_singleu sV
r c C s` |d krt }|jd}|d kr,tjjd}tjj|d}tjj|d}tjj|d}tjj|d}tj } tj ||f |j
\}
} | dkr|j rd} qd} n | dkrd|j } n t
d | d }
| |
krt
d j| d }| dkrxL||||fD ]}tj| qW n,ytjtj|}W n tk
r2 Y nX g d d d
}|d kr^di i}d |d d< x,|
D ]$}||d krd|j |d |< qdW |d }| |d< tj || d< ttdd | jj || d< tj|| tj tjj |||dd yR| | |}| d kr(|\}}|d k r,t ||d< n|}dd |D || d< W nP tk
r } z2tj t d| t!d| t |g|| d< W Y d d }~X nX tj || d < d |d< ttd d | jj || d< tj|| | d krPg }x2|
D ]*}|| d r|j"|| j#dg qW tj|d|d |d i tj tjj |||dd t$|| d S )!NrQ z/run/cloud-initz status.jsonz result.jsonr|
init-localmodulesz
modules-%szunknown name: %smodules-config
modules-finalz'Invalid cloud init mode specified '{0}')errorsstartfinishedv1r r r c S s
t | tS )N)rd r )hr+ r+ r, s z status_wrapper..Zrecoverable_errorsT)r c S s g | ] }t |qS r+ )rh ).0rp r+ r+ r,
s z"status_wrapper..r zfailed stage %szfailed run of stage %sr c S s
t | tS )N)rd r )r r+ r+ r, r ! s )r r )r| r r r )r| r )%r
rw r- r< normpathru r] getLoggerr Z ensure_dirsr4 r r\
ValueErrorr8 Zdel_filejsonloadsr r copytimere filterZhandlersZ export_logsr Z
write_jsonZsym_linkrelpathrh r r/ r) extendrI rC )r> r? Zdata_dZlink_drv Z status_pathZ status_linkZ result_pathZ result_linkZ root_logger_namefunctorr\ ZmodesstatusfZ
nullstatusrl r retr r rp r+ r+ r, status_wrapper s
$
r )r| c C s6 | j r2| jr2| jjd}tjj|s2| j jdd dS )zCWrite instance-data.json file if absent and datasource is restored.Z
instance_dataF)Z write_cacheN)r Z ds_restoredrv Z get_runpathr- r< r` Zpersist_instance_data)r| Zinstance_data_filer+ r+ r, r 7 s r c C sx | j }tj| j|dd\}}}|rtytjd| j|d W n8 tjk
rr } ztjd||t | W Y dd}~X nX dS )zCall set_hostname if metadata, vendordata or userdata provides it.
@param stage: String representing current stage in which we are running.
@param retry_stage: String represented logs upon error setting hostname.
T)Z
metadata_onlyZ set_hostnameNzGFailed setting hostname in %s stage. Will retry in %s stage. Error: %s.)
r r Zget_hostname_fqdnrJ r ZhandleZSetHostnameErrorr/ rD rh )r| r r ZcloudZhostnameZ_fqdn_rp r+ r+ r, r ? s r c C s t jjdjttjd d S )Nr# )r% stdoutr' ru sortedr ZFEATURES)r> r? r+ r+ r,
main_featuresV s r c " C s t | stj} tj| jdd}|jddddtj dd |jd d
d d d
tj dd |jdddddd |jdddddd |j
d d |j dd d }d |_ |j
d d d!}|jd"d#dd$dd |j
d tfd% |j
d&d'd!}|jd(d)d*d+d,dcd. |j
d&tfd% |j
d/d0d!}|jd1d2d*d3d d4 |jd5d*d6dttj d7 |jd8dd9dd4 |jd:d;d |j
d/tfd% |j
d?d@d!}|j
dAdBd!}|j
dAtfd% |j
dCdDd!}|j
dEdFd!} |j
dGdHd!}
|j
dIdJd!} |j
dKdLd!} |j
dMdNd!}
| rN| d }|dCkr*ddOlm} || n$|dEkrLddOlm} || n|dGkrddPlm}m} ||
|
j
dG|fd% n|dIkrddQlm}m} || | j
dI|fd% n|d?krddRl m}m } || |j
dS|fd% nf|dMkr ddTl m}m } ||
|
j
dM|fd% n2|dKkrNddUl m}m!} || | j
dK|fd% |j"| dV}|j#\} } | ddkrt$|j%r~t&j'nt&j( n|j%rt$ t)j* d | ksd&| krd |j+krt,} d } d } | d kr|j-rde\} } ndf\} } nZ| d&krd[|j+ d\|j+ } } n8| d/kr:d]|j. d^|j. } } |j/} n| } d_| } d} t0j1| | | d`|_2|j2$ t3j4t5j%da| d | | |fdb}!W d Q R X t6j7 |!S )gNr )progz --versionz-vr z %(prog)s z'Show program's version number and exit.)r4 r helpz--filez-fr; r: z(Use additional yaml configuration files.rb)r4 destr typez--debugz-d
store_truez:Show additional pre-action logging (default: %(default)s).F)r4 r defaultz--forcezDForce running even if no datasource is found (use at your own risk).r )r4 r r r )r Z Subcommands
subcommand)titler Tr| z2Initialize cloud-init and perform initial modules.)r z--localz-lz+Start in local mode (default: %(default)s).)r4 r z1Activate modules using a given configuration key.z--modez-mZstorez8Module configuration name to use (default: %(default)s).r final)r4 r r choicesZsinglezRun a single module.z--namez-nzModule name to run.)r4 r requiredz --frequencyz Module frequency for this run.)r4 r r r z--reportzEnable reporting.r *Zargumentz0Any additional arguments to pass to this module.)nargsmetavarr Zqueryz;Query standardized instance metadata from the command line.ZfeatureszList defined features.Zanalyzez-Devel tool: Analyze cloud-init logs and data.ZdevelzRun development tools.z collect-logsz*Collect and tar all cloud-init debug info.Zcleanz3Remove logs and artifacts so cloud-init can re-run.r z/Report cloud-init status or wait on completion.Zschemaz-Validate cloud-config files using jsonschema.)
get_parser)r handle_collect_logs_args)r handle_clean_args)r handle_argsZrender)r handle_schema_args)r handle_status_args)r?
init-local searching for local datasources init-network!searching for network datasourcesz
modules-%szrunning modules for %sz single/%szrunning single module %szrunning 'cloud-init %s')Zreporting_enabledzcloud-init mode '%s')Zlogfuncr* Z
get_uptimefuncr? )r| r r )r| r )r r )r r )8r r% argvargparseArgumentParserpop add_argumentr r9 ZFileTypeZ set_defaultsZadd_subparsersr Z
add_parserr r r r keysr r Zcloudinit.analyzer Zcloudinit.cmd.devel.parserZcloudinit.cmd.devel.logsr Zcloudinit.cmd.cleanr Zcloudinit.cmd.queryr cloudinit.config.schemar Zcloudinit.cmd.statusr
parse_argsr4 r rD r] r^ ZWARNINGr Zattach_handlersr\ r r r> Zreportr ZReportEventStackr r Zlog_timer/ r Z flush_events)"Z sysv_argsparserZ
subparsersZ parser_initZ
parser_modZ
parser_singleZ parser_queryZparser_featuresZparser_analyzeZ parser_develZparser_collect_logsZ parser_cleanZ
parser_statusZ
parser_schemar Zanalyze_parserZ devel_parserZ logs_parserr Z clean_parserr Z query_parserZhandle_query_argsZ
schema_parserr Z
status_parserr r? r> r ZrnameZ report_onZrdescZretvalr+ r+ r, mainZ s@
r __main__ZTZz:/etc/localtime)r )NrL rM )r )TN)NN)N)Mr r r- r% r r( r] Ztypingr Z cloudinitr r r r r r r r
r r Zcloudinit.cmd.develr
Zcloudinit.configr Zcloudinit.config.modulesr r r Z
cloudinit.logr r r r r r Zcloudinit.reportingr Zcloudinit.safeyamlr Zcloudinit.settingsr r r r r7 rB r r __name__r/ r) r1 r5 r3 r@ rH rK rS intrh rq r} r r r r r r r r r r r environr Z return_valueexitr+ r+ r+ r, sx
r a27G
{