H:jQ* d dl Z d dlZd dlZd dlZd dlmZ d dlmZ d dlm Z m
Z
d dl m Z m
Z
d dlmZmZmZ d dlmZ d dlmZ d d lmZ d d
lmZ d d lmZ d d l m Z d
Z dZ e dz Z dZ!dZ" G d de Z#dS ) N)clpwd)jwt_token_check)is_cmt_disabledis_client_enabled)ProcLve LIMIT_LVP_ID)
MySQLGovernorMySQLGovExceptionMySQLGovernorAbsent)LVEStat)LveStatsPlugin)mempages_to_bytes) get_domains)LVEUsage)write_file_via_tempfilezbThere was detected MySQL Governor and information about limits will be collected starting from nowz/Error while getting Mysql Governor limits: %s. zSince the governor doesn't seem to be well configured, the limits statistics won't be collected. This warning won't be repeated to prevent annoying spam in logs.zxCentralized Monitoring isn't enabled. CMCollector plugin won't collect data. It's expected behaviour for non CL+ clientsz}Centralized Monitoring has been detected! From now, CMCollector will gather limits statistics for it gently and affectionate.c t e Zd ZdZ G d d Zd Zd ZddZd Ze dd
e
d e fd Z d
Z
d ZdS ) CMCollectorzA
Collector plugin for Cloudlinux+ Centralized Monitoring
c 0 e Zd ZdZd Zd Zd Zd Zd ZdS )CMCollector.DomainsCachez=
Sub-class for keeping username:domain pairs
c > || _ i | _ d| _ d| _ d S )Nr iQ )logcachecache_creation_timecache_expiration_interval)selfloggers /builddir/build/BUILDROOT/lve-stats-5.0.4-1.el8.x86_64/opt/cloudlinux/venv/lib/python3.11/site-packages/lvestats/plugins/generic/cm_collector.py__init__z!CMCollector.DomainsCache.__init__: s& DHDJ'(D $-9D * * * c | r!| j d i | _ || j v r
| j | S | | }|r| || |S )Nz@Domains cache is expired, going to regenerate user-domains cache) _is_expiredr infor _get_real_valuesetr usernamedomains r getz CMCollector.DomainsCache.get@ s !!
`aaa
4:%%z(++))(33F
+6***Mr c | j sRt t j | _ | j dt
| j || j |< d S )Nz Cache creation timestamp: %s)r inttimer r r" strr% s r r$ z CMCollector.DomainsCache.setK sW :
]+.ty{{+;+;(
[>[\\\#)DJx r c d t t j | j z
| j k S )N)r* r+ r r r s r r! z$CMCollector.DomainsCache._is_expiredQ s& ty{{##d&>>A__ _r c T t |d d S # t $ r Y d S w xY w)NF)raise_exceptionr )r Exception)r r& s r r# z(CMCollector.DomainsCache._get_real_valueT sC
"8UCCCAFF
tt
s
''N) __name__
__module__ __qualname____doc__r r( r$ r! r# r r DomainsCacher 5 sl : : : * * * ` ` ` r r7 c t j d | _ d| _ d| _ d| _ d| _ d| _ d| _ d| _ | j
d t | _ t | _ t j | _ | | j | _ d S )NzCL+CM_Collectorr < z/var/lve/cm_lve.jsonFzCM Collector plugin init)logging getLoggerr nowperiod_filename_to_write_is_write_error_is_jwt_token_error_is_governor_absent_error_is_cm_enabled_errorr" r proc_lver governorr ClPwdget_sys_min_uidmin_uidr7
domains_cacher. s r r zCMCollector.__init__\ s $%677 "8 $ #( ).&$)!
0111
%
{}}4466 ! . .tx 8 8r c | j | \ }}| j r&| j t
d| _ n# t $ rF}| j s4| j t t | d| _ Y d}~dS d}~wt $ r8}| j t t | Y d}~dS d}~ww xY wd|id|dz idS )zn
Gets Mysql Governor limits and returns ready-to-send
dict with limits and zero-usage
FTNli ) mysql_cpumysql_io) rD get_limits_by_userrA r r" GOVERNOR_ENABLED_MSGr warningGOVERNOR_ABSENT_ERROR_MSGr, r
GOVERNOR_BASIC_ERROR_MSG)r r& cpuioes r _prepare_dbgov_limitsz!CMCollector._prepare_dbgov_limitsk s
m66x@@GC-
7
233316." 1
6 !:CFFCCC15.44444 H 5s1vv > > >44444 sR$Y
s$ A
A
C ;B
C %-CC r c R i }| j |d D ]}| j }t || }|j dk s|j t
k rG| t | || d ||j < |S )zF
Parse lve limits from /proc/lve via ProcLve instance
F)without_limitsr T) only_limits) rC linesversionr idr _lveusage_to_dictr init_limits_from_lvestat)r procslvp_idlimitslinerZ stats r
_parse_limitszCMCollector._parse_limits s M''u'EE Dm++--G4))Dw!||tw, 6 6 " 4 4!!::4GGUY 5 F47OO
r c i }| j rF| j D ],}| | || -| | | |S )zI
Returns dict with lve_id and it`s limits from /proc/lve
)r_ )rC resellers_supported lvp_id_listupdaterc )r r^ usersr_ s r _get_lve_userszCMCollector._get_lve_users s = , , . . G -3355
G
G T / /f / E EFFFF
T''../// r FusagerX c
|rCd| j dz id| j idt | j id| j id| j id| j idS t t | j dz | j dz | j
d| j | j | j dt t t | j
t | j | j dt t | j | j | j dt t | j | j | j dt t | j | j | j ddS )zL
Return ready-to-send dict with metrics by passed lve usage
rJ d )rR eppmemnprocrS iops)arJ f)lcpulepr lmemphylnprocrS liopsr* round cpu_usage cpu_faultmep mep_faultmemphy memphy_faultro nproc_faultio_usageio_faultrp
iops_fault)rj rX s r r\ z CMCollector._lveusage_to_dict sz
UZ# -.EI& /
> >? u|,EHo ek*
u//0036Z#%_
HH&s5 +>+>'?'?@@&u}55' u{++,,\& u~..//X^ uz**++[% -
r c ( g }| di }| | dd }| di }| D ]$\ }} t j | j }n# t $ r Y -w xY w| j | } | sN||| d}
||v r1|| } |
|
| n|
| ||v rA|| d || d d|
d < || d
|| d d|
d < n,| | } | |
| | |
&|S )
z
Returns list with metrics (lve&mysql) by each lve_id
In case there is some usage for lve_id -> it will be used
otherwise -> zero-usage values with actual lve/mysql limits are used
dbgov_data_for_cmr^ lve_usage)lve_idr& r' ry cpu_limit)rq rJ rK r io_limitrL )
popri r( itemspwdgetpwuidpw_namer1 rH rg r\ rU append)
r lve_data
lve_data_listr rh r r limits_datar& r'
lve_data_dictv mysql_limitss
r _prepare_metrics_to_sendz$CMCollector._prepare_metrics_to_send s
$LL)%>???? $$[111 ****62;?*62;?. .
k*
+62:>*62:>- -
j))
$ 9 9( C C +!(( 666 / / / / s 3B
BBc t \ }}}|s+| j s"| j d| d| _ dS t st s/| j s&| j t d| _ dS d| _ | j r&| j t d| _ t j
d| | i } t || j
d d| _ dS # t t f$ rF}| j s4| j t% | d| _ Y d}~dS Y d}~dS d}~ww xY w)z(
Main plugin entrypoint
zfJWT token error: '%s'. CM Collector plugin will not work, it is expected behaviour for non CL+ clientsTNF lve_statsi )r r@ r r" r r rB CM_DISABLED_MSGCM_ENABLED_MSGjsondumpsr r r> r? IOErrorOSErrorerrorr, )r r token_is_validtoken_error_msg_ json_resultrT s r executezCMCollector.execute s
.=->->* +
0
C#
,0( F $5$7$7 ,
1
o...,0) F#( $ . HMM. ) ) )(-D %j+t/L/LX/V/V!WXX , #K1H% P P P#(D ! , , ,'
,s1vv&&&'+$$$$$$$
,
,
,
,
,
, ,s ) D E 5EE N)r )F)r2 r3 r4 r5 r7 r rU rc ri staticmethodr boolr\ r r r6 r r r r 0 s % % % % % % % % N
9
9
9
4
(
(
(
(
(
(
\(
T+ + + Z#, #, #, #, #,r r )$r: r r r+ clcommonr clcommon.lib.jwt_tokenr clcommon.lib.cmt_utilsr r clcommon.clprocr r clcommon.libr r
r lvestatr lvestats.core.pluginr
lvestats.lib.commons.sizeutilr lvestats.lib.commons.funcr "lvestats.plugins.generic.analyzersr secureior rN rQ rP r r r r6 r r r s
2 2 2 2 2 2 E E E E E E E E 1 1 1 1 1 1 1 1 N N N N N N N N N N / / / / / / ; ; ; ; ; ; 1 1 1 1 1 1 7 7 7 7 7 7 , , , , , , i M % % $ j, j, j, j, j,. j, j, j, j, j,r