H:j%7 d dl Z d dlZd dlZd dlZd dlmZmZmZ d dlm Z d dl
m Z d dl m
Z
d dlmZmZ d dlmZ d dlmZ d d lmZmZ d d
lmZ d d lmZ d Zd
Z d\ Z Z Z e e e gZ e de diZ!dZ"d Z#d Z$ G d de Z% G d de Z&d*dZ'd+dZ(d Z)d,d Z*defd Z+d Z,d Z-d-d!Z.d" Z/d,d#Z0d$ Z1d.d%Z2d/d&Z3d/d'Z4d( Z5d) Z6dS )0 N)deleteeventfunc) Inspector)make_url)
_ModuleMarker)RelationshipProperty sessionmaker) mysql_lib)FormattedException)Basehistory LVE_STATS_2_TABLENAME_PREFIX)alembic_migratez/var/lve/lvestats2.dbi )mysql
postgresqlsqlitepymysqlpsycopg2shamanc t j | }t | }d |D |z
}t d t | D S )z^
Checks if views exist.
:param sqlalchemy.engine.base.Engine engine:
:return:
c " h | ] }t |z
S r ).0ns /builddir/build/BUILDROOT/lve-stats-5.0.4-1.el8.x86_64/opt/cloudlinux/venv/lib/python3.11/site-packages/lvestats/lib/dbengine.py z4find_not_existing_tables_or_views..1 s DDD014DDD c 3 L K | ] }| t d V dS ) N)replacer )r xs r z4find_not_existing_tables_or_views..2 s1 ZZ7<<ZZZZZZr )r from_enginesetget_view_namestuple)enginenames inspectorexisting not_existings r !find_not_existing_tables_or_viewsr. ) sj %f--I9++--..HDDeDDDxOL ZZeLFYFYZZZ Z ZZr c t t j j } g d}t j | s t dz fd| D S )zc
Used to call engine.create_all() without views that are described as Table()
:return:
z;/opt/cloudlinux/flags/enabled-flags.d/burstable-limits.flagbursting_eventsc & g | ]
}|j v |S r name)r t tables_for_disabled_featuress r
z4get_list_of_tables_without_views..A s& L L L!/K!K!KA!K!K!Kr )
dictr
metadatatablesvaluespathlibPathexistsappendr )r9 burstable_limits_feature_flagr5 s @r get_list_of_tables_without_viewsr@ 5 s
$-&
'
'
.
.
0
0F#% $a! <5 6 6 = = ? ? ^$++,HK\,\]]] L L L Lv L L LLr c e Zd ZdS )MakeDbExceptionN__name__
__module__ __qualname__r r r rB rB D Dr rB c e Zd ZdS )DatabaseConfigErrorNrC r r r rI rI H rG r rI Tc | d }|t dddid |r6|t vr-t d|d t dd | d }|t k r|t ddd id |t k r!| d
| d t
}n)t
| }| d | d
| }t || }|S )z
Extract and validate database connection uri from config
:param dict cfg:
:param bool check_support:
:return str:
db_typeNz#"%(config_variable)s" not in configconfig_variablemessagecontextz}Incorrect database type %(database_type)s. You should only use %(database_types)s. The correct db_type for mariadb is "mysql"z", ")
database_typedatabase_typesconnect_stringz:///sqlite_db_path+z://)getrI SUPPORTED_DATABASESjoinSQLITEDEFAULT_DB_PATHget_db_client_library_name
get_fixed_uri)cfg
check_supportrK rR uriclient_librarys r cfg_get_urir` L sA ggi G!=K\^gJh i i
(;;;! =-4 TgHhHhii
WW -..N&^ 3!=K\^nJo p p
&JJcgg&6 H HJJ3G<<>>>>>n>>GS)) Jr Fc V t j d } t | | }nN# t $ rA}d}dt | i} | || t
|| d |d}~ww xY w| d| d |d u r d
| v r| d
}|r&d }
t j
|d |
} n_t j
||| } | j t k rt j | dt | S )z
Create sqlalchemy database engine
:param dict cfg:
:param bool just_print:
:param bool debug:
:param pool_class:
:param bool check_support:
:return:
init_db_engine)r] z2Unable to configure database connection. %(error)serrorrM NzConnecting to database: %srK Fdebugc $ t | d S N)print)sql multiparamsparamss r dumpz make_db_engine..dump s #JJJJJr mock)strategyexecutor)echo poolclassconnect)logging getLoggerr` rI strrc rB info
sqlalchemyr)
create_engineurlget_backend_namerX r listen_set_sqlite_busy_timeout) r\
just_printrd
pool_classr] logrR emsgrO rk r) s r make_db_enginer u sS
,
-
-CK$S
FFF K K KBCFF# #w #' B BCCJ K HH
)3y>::: ~~'S..G F "00 &[_0``"00 eWa0bb : & & ( (F 2 2 L,D E E E Ms (
A3>EEGGL#|'9'9';';u'D'D K K K K K K K K ||$@AAHHJJH K K K K K K K K K K K K K K K
> *
%
0 0H < < ]^^^^^
Y
sH C AC C 'C C CC CC D3DDc t j d }|r-d|_ | t j ddg g d}t j | }| }t |j
D ]\ }}t |t r |j
} |d | | |v rd | | D }
t! j | } | j D ]M} t | t& r| j D ]-}
|
j |
vr"| d||
j | d|d< .N| d || | d|d
< |d | |d
r| d |d r| d
|S )Nvalidate_databaseF) table_error column_errormissing_tables
orm_tablesr c g | ]
}|d S r2 r )r cs r r6 z%validate_database.. s VVV!AfIVVVr z?Model %s declares column %s which does not exist in database %sTr z>Model %s declares table %s which does not exist in database %sr r zWYou can run 'lve-create-db --create-missing-tables' command to recreate missing tables.zLYou can try to recreate malformed table, or ask CloudLinux support for help.)rr rs propagate
addHandler NullHandlerr r% get_table_nameslist_decl_class_registryitems
isinstancer
__tablename__r> get_columnsrv inspectattrsr columnskeycritical)r) hide_loggingbaser~ resultdatabase_inspection real_tables__classtable real_columnsmapper column_propcolumns r r r s
/
0
0C .
w*,,--- "ER_a
b
bF#/77%5577K$399;;<< 3 3 6 fm , , $| ##E*** K VV/B/N/Nu/U/UVVVL '//F %|
:
: k+?@@ :"-"5 : :!:\99 LL a & &
& 6:F> 2:
:
LLY[achjp q q q$(F= ! # $ + +E 2 2 2 2
m p nooo
n e cddd Mr c H t | d }|d |d k S )NT)r r r )r )r) inspect_results r check_need_create_dbr s* &vDAAAN * +~l/K KKr c t j | t t | d d S )N)r9 T)stamp)r
r8
create_allr@ r r) s r create_dbr s= M V,L,N,N OOOF$''''''r c l |st | rt | d S t | | d S )N)
lve_stats_cfg)r r r )r) create_missing_tablesr\ s r setup_dbr
sG 3 4V < < 3&c222222r c D t j | d S rf )r
r8 drop_allr s r drop_tablesr s M6"""""r c . | }| } t t j j D ]\ }}|t | }nWt |t t f r t ||j
j |v }n t ||j
j |k }| | |
d S # t $ r | w xY wrf )rq beginr r
r8 r9 r r r r( r server_idr commit Exceptionrollback)r) r conn_transr table_object delete_querys r
clear_rowsr s NN E KKMME #DM$8$>$>$@$@ A A ( (OA| %l 3 3 Ie}55
[ %lLN4LPY4Y Z Z %lLN4LPY4Y Z Z MM, ' ' ' '
s CC4 4 Dc B t | t | d S rf )r r r s r recreate_dbr ' s$
fr c 4 | t j t j |k t j t j t j dk t j
t j dk }|#| t j |k }|#| t j |k }d |D S )Nr c g | ]
}|d S r r )r record_s r r6 z(find_lost_keep_alive..; s 5 5 57GAJ 5 5 5r ) queryr createdfilterr group_byhavingr maxidmin)sessionr
from_timestmp to_timestamplost_keepalives r find_lost_keep_aliver , s
go&& !Y. / / '/ " " $$q( ) ) $$q( ) ) '..w,/NOO '..w-/OPP 5 5n 5 5 55r c t | ||| }|sd S d t t j j D }||t j j < |D ]*}t di |}||_ | | +|
|r&| dt | | d S d S )Nc i | ]}|d S r r )r cols r
z'fix_lost_keep_alive..C s QQQ3QQQQr z*Was fixed %s losted keep alive records: %sr )
r r r __table__r keysr r r addr ru len) r r r r log_lost_keep_alivev2_keepalive_row timestamphistory_keepalives r fix_lost_keep_aliver > s *7I}l[[O QQ$w/@/H/M/M/O/O*P*PQQQ.7W&*+$ ' ' # 7 7&6 7 7$-! %&&&& NN g >O@T@TVefffffg gr c t | }t ||d ||| | d S )N)bindr )r r r )r
r r )r) r\ r r r r s r fix_dbr O sK 'l'''))G[!1 ]iptuuuu MMOOOOOr c f t | }|t dd| id |S )zZ
Get database Python client library name
:param str db_type:
:return str:
NzTThe client library to connect to the "%(database_type)s" database cannot be detectedrP rM )DB_CLIENT_LIBRARY_MAPrU rI )rK r_ s r rZ rZ V sN +..w77N !q#W
r c | | t k r|S t | }t t j | S )zo
Get fixed URI for the specified database
:param str db_type:
:param str uri:
:return str:
)MYSQLr rt r get_rfc1738_db_uri)rK r^ us r r[ r[ i s8 %
A y+A.. / //r )T)FFNTrf )FN)NN)NNN)7rr r; sqlalchemy.enginerv sqlalchemy.excr r r sqlalchemy.engine.reflectionr sqlalchemy.engine.urlr &sqlalchemy.ext.declarative.clsregistryr sqlalchemy.ormr r
clcommonr clcommon.clexceptionr lvestats.ormr
r r lvestats.utils.dbmigratorr rY r r
POSTGRESQLrX rV r
__author__r. r@ rB rI r` r r{ r r r r r r r r r r r rZ r[ r r r r s * * * * * * * * * * 2 2 2 2 2 2 * * * * * * @ @ @ @ @ @ = = = = = = = = 3 3 3 3 3 3 & & & & & & & & 5 5 5 5 5 5 5 5 5 5 5 5)
; z6 j&1 9
[ [ [ M M M ( , & & & &R$ $ $ $N .
.
.
.
b ,1t & & & &RL L L
( ( ( 3 3 3 3# # # $
6 6 6 6$g g g g" & 0 0 0 0 0r