3
\me"T @ s* U d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m
Z
m Z ddl m
Z
ddlmZ ddlmZ ddlmZ ddlmZmZmZ dd lmZ dd
lmZ dd l m Z m Z dd l m Z m!Z! dd
l"m#Z# dZ$e#Z%ddde$e ge%ededgg dZ&e &e e&Z ddgddZ'edZ(G dd dZ)ej*e+Z,e-e!e.d d d Z/G d d d e0Z1G d!d" d"e
Z2G d#d$ d$e2Z3G d%d& d&e2Z4G d'd( d(e2Z5d)d* Z6d+d, Z7d-d. Z8d/d0 Z9e:d1d2d3Z;d4d5 Ze-eee.dd:d;d<Z?d=e3fd>e4fd?e5ffZ@dS )@zGrowpart: Grow partitions N)ABCabstractmethod)suppress)Path)dedent)Tuple)subp
temp_utilsutil)Cloud)Config)
MetaSchema get_meta_doc) ALL_DISTROSDistro)
PER_ALWAYSa6 Growpart resizes partitions to fill the available disk space.
This is useful for cloud instances with a larger amount of disk space available
than the pristine image uses, as it allows the instance to automatically make
use of the extra space. Note that this only works if the partition to be
resized is the last one on a disk with classic partitioning scheme (MBR, BSD,
GPT). LVM, Btrfs and ZFS have no such restrictions.
The devices on which to run growpart are specified as a list under the
``devices`` key.
There is some functionality overlap between this module and the ``growroot``
functionality of ``cloud-initramfs-tools``. However, there are some situations
where one tool is able to function and the other is not. The default
configuration for both should work for most cloud instances. To explicitly
prevent ``cloud-initramfs-tools`` from running ``growroot``, the file
``/etc/growroot-disabled`` can be created. By default, both ``growroot`` and
``cc_growpart`` will check for the existence of this file and will not run if
it is present. However, this file can be ignored for ``cc_growpart`` by setting
``ignore_growroot_disabled`` to ``true``. For more information on
``cloud-initramfs-tools`` see: https://launchpad.net/cloud-initramfs-tools
On FreeBSD, there is also the ``growfs`` service, which has a lot of overlap
with ``cc_growpart`` and ``cc_resizefs``, but only works on the root partition.
In that configuration, we use it, otherwise, we fall back to ``gpart``.
Note however, that ``growfs`` may insert a swap partition, if none is present,
unless instructed not to via ``growfs_swap_size=0`` in either ``kenv(1)``, or
``rc.conf(5)``.
Growpart is enabled by default on the root partition. The default config for
growpart is::
growpart:
mode: auto
devices: ["/"]
ignore_growroot_disabled: false
Z cc_growpartZGrowpartzGrow partitionsz growpart:
mode: auto
devices: ["/"]
ignore_growroot_disabled: false
z growpart:
mode: growpart
devices:
- "/"
- "/dev/vdb1"
ignore_growroot_disabled: true
)idnametitle descriptionZdistros frequencyZexamplesZactivate_by_schema_keysauto/F)modedevicesignore_growroot_disabledz/cc_growpart_keydatac @ s e Zd ZdZdZdZdZdS )RESIZESKIPPEDCHANGEDNOCHANGEFAILEDN)__name__
__module__ __qualname__r r r r r$ r$ !/usr/lib/python3.6/cc_growpart.pyr o s r )r distror c C s d }| dkrFx*t D ]"\}}||}|j|dr|}P qW |stdn^i }xt D ]\}} | ||< qPW | |krxtd| || |}
|
j|dr|
}|std| |S )Nr )r zNo resizers availablezunknown resize mode %szmode %s not available)RESIZERS available
ValueError TypeError) r r& r Z resize_class_nameresizerZcurZmmapkvZmclassr$ r$ r% resizer_factoryy s(
r/ c @ s e Zd ZdS )ResizeFailedExceptionN)r! r" r# r$ r$ r$ r% r0 s r0 c @ s: e Zd ZedddZeeedddZedd Z d S )
Resizer)r& c C s
|| _ d S )N)_distro)selfr& r$ r$ r% __init__ s zResizer.__init__)r returnc C s d S )Nr$ )r3 r r$ r$ r% r( s zResizer.availablec C s d S )Nr$ )r3 diskdevpartnumpartdevr$ r$ r% resize s zResizer.resizeN)
r! r" r# r r4 r listboolr( r9 r$ r$ r$ r% r1 s r1 c @ s" e Zd ZedddZdd ZdS )ResizeGrowPart)r c C sX t jj }d|d< y*tjddg|d\}}tjd|r:dS W n tjk
rR Y nX dS ) NCLANGgrowpartz--help)envz --update\s+TF)osenvironcopyr researchProcessExecutionError)r3 r myenvoutZ_errr$ r$ r% r( s
zResizeGrowPart.availablec
& C s8 t jj }d|d< t|}| jj }tj|dd}t jj |d}t jj
|sZt j |d ||d< yt j dd||g|d W nJ t j
k
r } z,| jd
krtjtd || t| | ||fS d } ~ X nX yt j d||g|d W n@ t j
k
r } z tjtd || t| | W Y d d } ~ X nX W d Q R X |t|fS )
Nr= r> T)dirZ needs_exer? i ZTMPDIRz --dry-run)r@ z&Failed growpart --dry-run for (%s, %s)zFailed: growpart %s %s)rA rB rC get_sizer2 Zget_tmp_exec_pathr Ztempdirpathjoinexistsmkdirr rF exit_coder
logexcLOGr0 )
r3 r6 r7 r8 rG beforeZtmp_dirZtmpdZ growpart_tmper$ r$ r% r9 s6
&zResizeGrowPart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% r< s
r< c @ s& e Zd ZdZedddZdd ZdS ) ResizeGrowFSa
Use FreeBSD ``growfs`` service to grow root partition to fill available
space, optionally adding a swap partition at the end.
Note that the service file warns us that it uses ``awk(1)``, and as
such requires ``/usr`` to be present. However, cloud-init is installed
into ``/usr/local``, so we should be fine.
We invoke the ``growfs`` with ``service growfs onestart``, so it
doesn't need to be enabled in ``rc.conf``.
)r c C s t jjdo|dgkS )z'growfs only works on the root partitionz/etc/rc.d/growfsr )rA rL isfile)r3 r r$ r$ r% r( s zResizeGrowFS.availablec C sd t |}y| jjddd W n: tjk
rV } z tjtd t||W Y d d }~X nX |t |fS )NZonestartgrowfs)actionZservicez Failed: service growfs onestart) rK r2 Zmanage_servicer rF r
rQ rR r0 )r3 r6 r7 r8 rS rT r$ r$ r% r9 s zResizeGrowFS.resizeN)r! r" r# __doc__r: r( r9 r$ r$ r$ r% rU s rU c @ s" e Zd ZedddZdd ZdS ) ResizeGpart)r c C s^ t jj }d|d< y0tjddg|ddgd\}}tjd|r@d S W n tjk
rX Y nX d
S ) Nr= r> gparthelpr rJ )r@ rcszgpart recover TF)rA rB rC r rD rE rF )r3 r rG Z_outerrr$ r$ r% r( s
zResizeGpart.availablec C s yt j dd|g W nF t jk
rZ } z(|jdkrJtjtd| t||W Y dd}~X nX t|}yt j ddd||g W n> t jk
r } z tjtd|| t||W Y dd}~X nX |t|fS ) a9
GPT disks store metadata at the beginning (primary) and at the
end (secondary) of the disk. When launching an image with a
larger disk compared to the original image, the secondary copy
is lost. Thus, the metadata will be marked CORRUPT, and need to
be recovered.
r[ Zrecoverr zFailed: gpart recover %sNr9 z-iz Failed: gpart resize -i %s %s)r rF rP r
rQ rR r0 rK )r3 r6 r7 r8 rT rS r$ r$ r% r9 s
zResizeGpart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% rZ s
rZ c C s0 t j| t j}zt j|dt jS t j| X d S )Nr )rA openO_RDONLYlseekSEEK_ENDclose)filenamefdr$ r$ r% rK s rK c C s t jj| }t jj|}d| }tj rVdtj| }tjd|}|rV|d |d fS t jj |srt
d| |f t jj |d}t jj |st d| tj
|j }t jj|}t jj|} tj
t jj | dj }
t jjd |
} | |fS )
Nz/sys/class/block/%sz/dev/z/^(?P/dev/.+)[sp](?P\d+[a-z]*)$devZ
part_slicez%s had no syspath (%s) partitionz%s not a partitionz
/dev/block/%s)rA rL realpathbasenamer
Zis_BSDZfind_freebsd_partrD rE rN r) rM r* Z load_filerstripdirname) ZdevpathZrpathZbnameZsyspathZfpartmZptpathptnumZrsyspathZ disksyspathZ
diskmajminZ diskdevpathr$ r$ r% device_part_info& s( rn c C st | j dr| S tj| }|s$td|d }tj }|dkrp| rptjtj }|d krptjj |rh|S td|S )Nz/dev/z,Could not determine device of '%s' % dev_entr z /dev/rootz!Unable to find device '/dev/root')
startswithr
Zget_mount_infor) Z is_containerZrootdev_from_cmdlineZ get_cmdlinerA rL rN )deventresultrf Z containerr$ r$ r%
devent2devQ s
rr c C s, t jj| }|jdr(tjd| | |S dS )a Returns underlying block device for a mapped device.
If it is mapped, blockdev will usually take the form of
/dev/mapper/some_name
If blockdev is a symlink pointing to a /dev/dm-* device, return
the device pointed to. Otherwise, return None.
z/dev/dm-z$%s is a mapped device pointing to %sN)rA rL rh ro rR debug)blockdevrh r$ r$ r% get_mapped_deviceh s
ru )r5 c C s t jdstjd dS yt j dd| g W nH t jk
rt } z*|jdkrXtjd| ntjd|j dS d}~X nX tt j" t j dd |g tjd
| d S Q R X dS ) z
Check if a device is an encrypted device. blockdev should have
a /dev/dm-* path whereas partition is something like /dev/sda1.
cryptsetupz6cryptsetup not found. Assuming no encrypted partitionsFstatus z#Determined that %s is not encryptedzZReceived unexpected exit code %s from cryptsetup status. Assuming no encrypted partitions.NZisLuksz Determined that %s is encryptedT)r ZwhichrR rs rF rP warningr )rt rg rT r$ r$ r% is_encryptedx s"
rz c C s ddd| g}t j |d }|jds2td| y d|jdd jd
d S tk
r } z td | d | d
|W Y d d }~X nX d S )NZdmsetupZdepsz--options=devnamer z1 dependz5Expecting '1 dependencies' from 'dmsetup'. Received: z/dev/z: (rJ )zRan `z$`, but received unexpected stdout: ``)r ro RuntimeErrorsplit
IndexError)rt ZcommandZdeprT r$ r$ r% get_underlying_partition s
r c 0 C s, t j stjdfS y t k
r } z"|j|tjd||f f wW Y d d }~X nX tj
|j rtj |j r|j|tjd| f qt
|}|ryt|}t||r^|dd |D kr>|jd| |jd| wt||\} }
|j|| |
f n|j|tjd| df W q tk
r } z$|j|tjd | d
| f W Y d d }~X qX qyt|\} } W nD ttfk
r } z"|j|tjd ||f f wW Y d d }~X nX yZ| j| | |\}
}|
|krP|j|tjd | | f f n |j|tjd
| | |
|f f W q tk
r } z"|j|tjd| | |f f W Y d d }~X qX qW |S )Nr z unable to convert to device: %szstat of '%s' failed: %sz device '%s' not a block devicec S s g | ] }|d qS )r r$ ).0xr$ r$ r%
s z"resize_devices..zResizing mapped device (z!) skipped as it is not encrypted.zResizing encrypted device (z
) failed: z device_part_info(%s) failed: %sz no change necessary (%s, %s)z changed (%s, %s) from %s to %sz'failed to resize: disk=%s, ptnum=%s: %s)rC poprr r) appendr r rA statOSErrorS_ISBLKst_modeS_ISCHRru r rz insertr r r rn r* r9 r r r0 )r, r inforp rt rT ZstatretZunderlying_blockdevrg rw messageZdiskrm oldnewr$ r$ r% resize_devices s
&
&r )r cfgcloudargsr5 c
C s d|kr t jdt t|d< |jd}t|ts>t jd d S |jdd}tj|r||dkrltj ddd d
t jd | d S tj|jd d
rt
j j drt jd t jd d S tj
|ddg}t|st jd d S yt||j|d}W nB ttfk
r. } z t jd|| |dkr |d S d }~X nX tjt jdt||fd} x@| D ]8\}
} } | tjkrtt jd|
| nt jd|
| | qNW d S )Nr? z.No 'growpart' entry in cfg. Using default: %sz#'growpart' in config was not a dictr r Zoffz)Growpart's 'mode' key with value '{mode}'z22.2zUse 'off' instead.)Z
deprecatedZdeprecated_versionZ
extra_messagezgrowpart disabled: mode=%sr Fz/etc/growroot-disabledz0growpart disabled: /etc/growroot-disabled existsz&use ignore_growroot_disabled to ignorer r zgrowpart: empty device list)r& r z,growpart unable to find resizer for '%s': %sr )Zlogfuncmsgfuncr z'%s' resized: %sz '%s' %s: %s)rR rs DEFAULT_CONFIGget
isinstancedictry r
Zis_falseZ deprecaterA rL rV Zget_cfg_option_listlenr/ r& r) r* Zlog_timer r r r )
r r r r Zmycfgr r r, rT ZresizedentryrX r r$ r$ r% handle^ sT
r r? rW r[ )ArY r rC r ZloggingrA Zos.pathrD r abcr r
contextlibr Zpathlibr textwrapr Ztypingr Z cloudinitr r r
Zcloudinit.cloudr Zcloudinit.configr Zcloudinit.config.schemar
r Zcloudinit.distrosr r Zcloudinit.settingsr ZMODULE_DESCRIPTIONr metar r r Z getLoggerr! rR r r: r/ r r0 r1 r< rU rZ rK rn rr ru r; rz r r r r r' r$ r$ r$ r% st '
3 '+7 8