3
\mep @ s U d Z ddlZddlZddlZddlmZ ddlmZmZ ddl m
Z
ddl m Z ddl
mZmZ ddlmZ dd lmZ ejd
Zejd Zejd Zejd
ZejdZejdZejdZddiZ ej e Z dZ ddde egeedgddgdZ!e!ee!Z e"e e
e#ddd d Z$d d Z%d d! Z&dTd"d#Z'dUd%d&Z(d'd( Z)dVd)d*Z*d+d, Z+d-d. Z,dWd0d1Z-d2d3 Z.d4d5 Z/d6d7 Z0d8d9 Z1d:d; Z2dd? Z4d@dA Z5dBdC Z6dDdE Z7dFdG Z8dHdI Z9dJdK Z:dLdM Z;dNdO ZdS )Xz1Disk Setup: Configure partitions and filesystems. N)dedent)subputil)Cloud)Config)
MetaSchema get_meta_doc) ALL_DISTROS) PER_INSTANCEZsfdiskZsgdiskZlsblkZblkidZblockdevZ partprobeZwipefsZLANGCai This module is able to configure simple partition tables and filesystems.
.. note::
for more detail about configuration options for disk setup, see the disk
setup example
.. note::
if a swap partition is being created via ``disk_setup`` then a ``fs_entry``
entry is also needed in order for mkswap to be run, otherwise when swap
activation is later attempted it will fail.
For convenience, aliases can be specified for disks using the
``device_aliases`` config key, which takes a dictionary of alias: path
mappings. There are automatic aliases for ``swap`` and ``ephemeral``, where
``swap`` will always refer to the active swap partition and ``ephemeral``
will refer to the block device of the ephemeral image.
Disk partitioning is done using the ``disk_setup`` directive. This config
directive accepts a dictionary where each key is either a path to a block
device or an alias specified in ``device_aliases``, and each value is the
configuration options for the device. File system configuration is done using
the ``fs_setup`` directive. This config directive accepts a list of
filesystem configs.
Z
cc_disk_setupz
Disk Setupz$Configure partitions and filesystemsan device_aliases:
my_alias: /dev/sdb
swap_disk: /dev/sdc
disk_setup:
my_alias:
table_type: gpt
layout: [50, 50]
overwrite: true
swap_disk:
table_type: gpt
layout: [[100, 82]]
overwrite: true
/dev/sdd:
table_type: mbr
layout: true
overwrite: true
fs_setup:
- label: fs1
filesystem: ext4
device: my_alias.1
cmd: mkfs -t %(filesystem)s -L %(label)s %(device)s
- label: fs2
device: my_alias.2
filesystem: ext4
- label: swap
device: swap_disk.1
filesystem: swap
- label: fs3
device: /dev/sdd1
filesystem: ext4
mounts:
- ["my_alias.1", "/mnt1"]
- ["my_alias.2", "/mnt2"]
- ["swap_disk.1", "none", "swap", "sw", "0", "0"]
- ["/dev/sdd1", "/mnt3"]
disk_setupfs_setup)idnametitle descriptionZdistrosZ frequencyZexamplesZactivate_by_schema_keys)r cfgcloudargsreturnc s |j di fdd}|j d}t|trt|| tjdt| x|j D ]~\}}t|tsrtjd| qRy*tjd t j
tjd| t ||fd W qR t k
r } zt j
td
| W Y d d }~X qRX qRW |j d } t| trtjd
t| t| | x| D ]}t|ts*tjd| q
y2tjd |j d}
t j
tjd|
t|fd W n4 t k
r } zt j
td| W Y d d }~X nX q
W d S )z[
See doc/examples/cloud-config-disk-setup.txt for documentation on the
format.
device_aliasesc s j | } j|p| p|S )N)getZdevice_name_to_device)Zcandr )r r #/usr/lib/python3.6/cc_disk_setup.pyalias_to_devicey s
z handle..alias_to_devicer zPartitioning disks: %sz Invalid disk definition for %sz!Creating new partition table/diskzCreating partition on %s)Zlogfuncmsgfuncr z Failed partitioning operation
%sNr
zsetting up filesystems: %sz"Invalid file system definition: %szCreating new filesystem.devicezCreating fs for %sz%Failed during filesystem operation
%s)r
isinstancedictupdate_disk_setup_devicesLOGdebugstritemswarningr Zlog_timemkpart Exceptionlogexclistupdate_fs_setup_devicesmkfs) r r r r r r disk
definitioner
r r )r r r handler sJ
&
r/ c C s xt | D ]t}||}|d ks
||kr(q
|| krDtjd|| | |= | | | |< t| | trj|| | d< | |= tjd|| q
W d S )Nz0Replacing %s in disk_setup for translation of %s _orignamez,updated disk_setup device entry '%s' to '%s')r) r! infor r r" )r tformerorignameZ transformedr r r r s$ r c C s x| D ]}t |ts"tjd| q|jd}|d kr6qtj|\}}||}|d k rx|}tjd||| ||d< ||d< |rd|krtjd||| |d |d< ||d< qW d S )Nz"entry in disk_setup not a dict: %sr z %s is mapped to disk=%s part=%sr0 partitionzKPartition '%s' from dotted device name '%s' overrides 'partition' key in %sZ
_partition)r r r! r% r r Zexpand_dotted_devnamer" )r r2 r- r3 ZdevpartZtformedr r r r* s0
r* c c sD t j| }|r||d }x$dd |D D ]\}}||fV q*W dS )zd
Returns the key/value pairs of output sent as string
like: FOO='BAR' HOME='127.0.0.1'
Nc S s g | ]}|j d qS )=)split).0xr r r
s z"value_splitter..)shlexr7 )valuesstartZ_valueskeyvaluer r r value_splitter s
r@ Fc c s t ddd| g}|r |jd d}ytj|\}}W n4 tk
rf } ztd| |f |W Y dd}~X nX dd |j j D }xB|D ]:}ddddd }x t|D ]\} }
|
|| j < qW |V qW dS )
a
Enumerate the elements of a child device.
Parameters:
device: the kernel device name
nodeps : don't enumerate children devices
Return a dict describing the disk:
type: the entry type, i.e disk or part
fstype: the filesystem type, if it exists
label: file system label, if it exists
name: the device name, i.e. sda
z--pairsz--outputzNAME,TYPE,FSTYPE,LABELz--nodepsNz"Failed during disk check for %s
%sc S s g | ]}t |j d kr|qS )r )lenr7 )r8 r9 r r r r: s z"enumerate_disk..)r typefstypelabel) LSBLK_CMDappendr r' RuntimeErrorstrip
splitlinesr@ lower) r nodepsZ lsblk_cmdr1 _errr. partsr5 dr> r? r r r enumerate_disk s.
rO c C s. x(t | ddD ]}d|kr|d j S qW dS )z@
Return the device type of the device by calling lsblk.
T)rK rB N)rO rJ )r rN r r r device_type& s rP c C sX d}y t | }W n tk
r0 tjd| dS X |rB|dkrBdS | rT|dkrTdS dS )z0
Check if the device is a valid device.
z Query against device %s failedFr5 Tr, )rP r' r! r% )r r4 Zd_typer r r is_device_valid1 s rR c
C s d
\}}}}t dd| g}ytj|ddgd\}}W n4 tk
rf } ztd| |f |W Y dd}~X nX |rt|j dkrxLt|dd D ]<\}} |j d
kr| }q|j d kr| }q|j d kr| }qW |||fS )z
Check if the device has a filesystem on it
Output of blkid is generally something like:
/dev/sda: LABEL="Backup500G" UUID="..." TYPE="ext4"
Return values are device, label, type, uuid
Nz-cz /dev/nullr )rcsz"Failed during disk check for %s
%s )r= rD rB uuid)NNNN) BLKID_CMDr r' rG rA rI r@ rJ )
r outrD fs_typerV Z blkid_cmdrL r. r> r? r r r check_fsC s$ rZ c C s t | \}}}|S )z7
Returns true if the device has a file system.
)rZ )r _rY r r r
is_filesystemc s r\ Tc C s |dkr d}|sddg}d}xt | D ]}|d |krN|dkrNd|d dfS |d |kr|rj|d |ksp| rd|d d
fS |d |kr&|d dks|d rd
}|d dkrq&|d s&d|d dfS q&W |s| dfS tjd d
S )a
Find a device that is either matches the spec, or the first
The return is value is (, ) where the device is the
device to use and the bool is whether the device matches the
fs_type and label.
Note: This works with GPT partition tables!
NrQ r, r5 FrC z/dev/%sr rD TrB z5Failed to find device during available device search.)NF)rO r! r% )r rY rD Z
valid_targets label_match
replace_fsZraw_device_usedrN r r r find_device_nodek s,
r_ c C s2 t tt| dkrdS t| \}}}|r.dS dS )z
Check if the device is currently used. Returns true if the device
has either a file system or a partition entry
is no filesystem found on the disk.
rU TF)rA r) rO rZ )r r[ check_fstyper r r is_disk_used s ra c C sr y,t j td| g\}}t j td| g\}}W n4 tk
r` } ztd| |f |W Y d d }~X nX t|t| S )Nz --getsize64z--getsszFailed to get %s size
%s)r
BLKDEV_CMDr' rG int)r Z
size_in_bytesr[ Z sector_sizer. r r r get_hdd_size s $rd c C s t | td| g}ytj|d| d\}}W n4 tk
r` } ztd| |f |W Y dd}~X nX g }x|j D ]}|j }t|dkrqp| |d krp|d
j dkrqpd} x@t t
dt|d
d D ]&}
||
j r||
d kr||
} P qW |j | qpW |S )z
Returns true if the partition layout matches the one on the disk
Layout should be a list of values. At this time, this only
verifies that the number of partitions and their labels is correct.
z-lz%s
)dataz(Error running partition command on %s
%sNr rU extendedemptyT)reverse/)rf rg )
read_parttbl
SFDISK_CMDr r' rG rI r7 rA rJ sortedrangeisdigitrF ) r layoutprt_cmdrX rL r. found_layoutline_lineZ
type_labelr9 r r r check_partition_mbr_layout s.
ru c C s t d| g}ytj|td\}}W n4 tk
rT } ztd| |f |W Y d d }~X nX t|j }x |D ]}|j jdrhP qhW dd |D }g } x8|D ]0}
t |
dkr|
j
dr|
d d
}
| j |
qW | S ) Nz-p)Z
update_envz(Error running partition command on %s
%sNumberc S s g | ]}|j j d qS ) )rH r7 )r8 rs r r r r: s z.check_partition_gpt_layout.. Z00r rS )
SGDISK_CMDr
LANG_C_ENVr' rG iterrI rH
startswithrA endswithrF ) r rp rq rX rL r. Z out_linesrs ZcodesZcleanedcoder r r check_partition_gpt_layout s$
r c C s d| krt ||}n d| kr(t||}ntdtjd| ||| t|trd|r`t|dkr`dS dS t|t|krdd |D }tjd
|| x2t||D ]$\}}|d k rt |t |krdS qW dS dS ) z
See if the partition lay out matches.
This is future a future proofing function. In order
to add support for other disk layout schemes, add a
function called check_partition_%s_layout
gptmbrz Unable to determine table typez6called check_partition_%s_layout(%s, %s), returned: %srU TFc S s* g | ]"}t |ttfr"t|d ndqS )rU N)r tupler) r# )r8 r9 r r r r: 2 s z*check_partition_layout..z Layout types=%s. Found types=%sN)
r ru rG r! r" r boolrA zipr# )
table_typer rp rr Z layout_typesZitypeZftyper r r check_partition_layout s0
r c
C s t |t rt |trdS t|dkr0t |ts sz
%5&
2
2
').9G