3
\mer' @ s d Z ddlZddlZddlZddlZddlZddlmZ ddlmZ ddl m
Z
ddl m Z ddl
mZ ddlmZmZ dd lmZ dd
lmZmZmZmZ d d gZd
ZG dd de
ZeddeddeddgZ eddeddedded d ed d ed d!ed"d#ed$d%ed&d'ed(d)ed*d)ed+d,g Z e d-d.d/Z e d-d0d1Z dHd2d3Z!d4d5 Z"d6d7 Z#d8d9 Z$d:d; Z%dd? Z'dIe(d@dAdBZ)dCdD Z*dEdF Z+e,dGkrej-e+ dS )JzGDefine 'collect-logs' utility and handler to include in cloud-init cmd. N)datetime)Path)
NamedTuple)read_cfg_paths)Paths)ProcessExecutionErrorsubp)tempdir)chdircopy
ensure_dir
write_filez/var/log/cloud-init.logz /var/log/cloud-init-output.logz/run/cloud-initc @ s e Zd ZU eedS )
ApportFileN)__name__
__module__ __qualname__strpathZlabel r r /usr/lib/python3.6/logs.pyr s
r z(/var/log/installer/autoinstall-user-dataZAutoInstallUserDataz/autoinstall.yamlZAutoInstallYAMLz'/etc/cloud/cloud.cfg.d/99-installer.cfgZInstallerCloudCfgz//var/log/installer/ubuntu_desktop_installer.logZUdiLogz-/var/log/installer/subiquity-server-debug.logZSubiquityServerDebugz-/var/log/installer/subiquity-client-debug.logZSubiquityClientDebugz%/var/log/installer/curtin-install.logZ CurtinLogz0/var/log/installer/subiquity-curtin-install.confZCurtinInstallConfigz8/var/log/installer/curtin-install/subiquity-initial.confZCurtinConfigInitialz:/var/log/installer/curtin-install/subiquity-curthooks.confZCurtinConfigCurtHooksz8/var/log/installer/curtin-install/subiquity-extract.confZCurtinConfigExtractz=/var/log/installer/curtin-install/subiquity-partitioning.confZCurtinConfigPartitioningz(/var/log/installer/curtin-error-logs.tarZ CurtinErrorz$/var/log/installer/curtin-errors.tarz(/var/log/installer/block/probe-data.jsonZ ProbeData)returnc C s t } | jdS )NZ userdata_raw)r Z
get_ipath_cur)pathsr r r _get_user_data_fileN s r c C s t } | jdS )Ndata)r Z get_cpath)r r r r _get_cloud_data_pathS s r c C s` | st jddd} | jdddddd d
| jd d d
dd t }| jddddddj|d | S )a2 Build or extend and arg parser for collect-logs utility.
@param parser: Optional existing ArgumentParser instance representing the
collect-logs subcommand which will be extended to support the args of
this utility.
@returns: ArgumentParser with proper argument configuration.
z collect-logsz)Collect and tar all cloud-init debug info)prog descriptionz --verbosez-vcountr verbosityzBe more verbose.)actiondefaultdesthelpz --tarfilez-tzcloud-init.tar.gzzOThe tarfile to create containing all collected logs. Default: cloud-init.tar.gz)r r" z--include-userdataz-uF
store_trueuserdatazPOptionally include user-data from {0} which could contain sensitive information.)r r r! r" )argparseArgumentParser add_argumentr format)parseruser_data_filer r r
get_parserX s4
r+ c C s* dg}t j dkr&|jti jd |S )z>Return a list of files to ignore for /run/cloud-init directoryzhook-hotplug-cmdr Zinstance_data_sensitive)osgetuidappendr Zlookups)curdirfilesZ
ignored_filesr r r _copytree_rundir_ignore_files s r1 c C s t tjj| yt| j}W n@ tk
r^ } z$t|t| t d| d| W Y dd}~X n X t|| t d| d| |S dS )zCHelper which runs a command and writes output or error to filename.zcollecting %s failed.
Nz
collected %s
)
r r, r dirnamer stdoutr r
r _debug)cmdfilenamemsgr outputer r r _write_command_output_to_file s "
r; c C s t tjj| y*t|d}tj| ||d W dQ R X W n@ tk
rz } z$t|t | t
d| d| W Y dd}~X nX t
d| d| dS )zCHelper which runs a command and writes output or error to filename.w)r4 stderrNzcollecting %s failed.
r2 z
collected %s
) r r, r r3 open
subprocessZcallOSErrorr
r r5 )r6 r7 r8 r fr: r r r _stream_command_output_to_file s "rB c C s ||krt jj| d S )N)sysr= write)r8 levelr r r r r5 s r5 c C s< t jj| r(t| | td| d| ntd| d| d S )Nzcollected file: %s
r2 zfile %s did not exist
)r, r isfiler r5 )r Zout_dirr r r r
_collect_file s
rH c C s xBt D ]:}t| |j j}|j s.tt| t|jt|| qW |rxBtD ]:}t| |j j}|j svtt| t|jt|| qNW dS )z'Obtain subiquity logs and config files.N) INSTALLER_APPORT_FILESr r parentexistsr r rH INSTALLER_APPORT_SENSITIVE_FILES)log_dirinclude_userdatar Zsrc_fileZdestination_dirr r r collect_installer_logs s
rO )rN c # C s |r t j dkr tjjd dS t jj| } tj j j
d}t dd }t jj ||}t
ddgt jj |d d
|d }t
d d
ddgt jj |dd|d }|s|r|nd}td| td| d| tdgt jj |dd|d tddddgt jj |dd |d xtD ]}t||| qW |r6t }t||| t||| t jj |d } t| t jjtry tjtt jj | dtd W nF tjk
r }
z&tjjd tjjt |
d W Y d!d!}
~
X nX td"t d| ntd#t d| t jjt jj td$r6t t } | j r6tjt | t |t | t |" t d%d&| |j!|d' d(g W d!Q R X W d!Q R X tjjd)| dS )*zCollect all cloud-init logs and tar them up into the provided tarfile.
@param tarfile: The path of the tar-gzipped file to create.
@param include_userdata: Boolean, true means include user-data.
r zMTo include userdata, root user is required. Try sudo cloud-init collect-logs
r2 zcloud-init-logs-%Y-%m-%dz/tmp)dirz
cloud-initz --versionversionzcloud-init --version)r6 r7 r8 r z
dpkg-queryz--showz-f=${Version}
z dpkg-versionz dpkg versionz
not-availablez version: z!collected cloud-init version: %s
Zdmesgz dmesg.txtz dmesg outputZ
journalctlz--boot=0z-oz
short-precisez journal.txtz systemd journal of current bootZrun)ignorez(Failed collecting file(s) due to error:
Nzcollected dir %s
z directory '%s' did not exist
ZdisabledZtarZczvf/ z Wrote %s
)"r, r- rC r= rD r abspathr ZutcnowZdateZstrftimer joinr; printr5 rB CLOUDINIT_LOGSrH r rO r rK CLOUDINIT_RUN_DIRshutilZcopytreer1 Errorr r r r
r replace) tarfilerN r rM Ztmp_dirrQ Zdpkg_verlogr* Zrun_dirr: Zcloud_data_dirr r r collect_logs s
&
0r` c C s t |j|j|jS )z:Handle calls to 'cloud-init collect-logs' as a subcommand.)r` r^ r$ r )nameargsr r r handle_collect_logs_args s rc c C s t } td| j S )z4Tool to collect and tar all cloud-init related logs.z collect-logs)r+ rc
parse_args)r) r r r main" s re __main__)N)r ).__doc__r% r, r[ r? rC r Zpathlibr Ztypingr Zcloudinit.cmd.develr Zcloudinit.helpersr Zcloudinit.subpr r Zcloudinit.temp_utilsr Zcloudinit.utilr
r r r
rY rZ r rL rI r r r r+ r1 r; rB r5 rH rO boolr` rc re r exitr r r r st
.
U