e f{) @ s< d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d d d d d
d d d
d d d d d d g Z d Z
d Z d Z d Z
d Z d Z d Z d a d a d d Z d d Z d d Z d d Z d d Z d d d
Z d! d Z e j Z e j Z d" d# Z d$ d Z i Z e j Z! Gd% d d e" Z# d d& d' Z$ d( d
Z% d a& e e e$ e j' e j( d) d* Z) e j* e) Gd+ d d e" Z+ Gd, d d e j, Z- y e j. d- Z/ Wn e0 k
r d. Z/ Yn Xd/ d Z1 d0 d1 Z2 d S)2 N) _args_from_interpreter_flags )process sub_debugdebuginfo sub_warning
get_logger
log_to_stderr get_temp_dirregister_after_fork
is_exitingFinalizeForkAwareThreadLockForkAwareLocalclose_all_fds_exceptSUBDEBUG
SUBWARNING
Zmultiprocessingz+[%(levelname)s/%(processName)s] %(message)sFc G s t r t j t | | n d S)N)_loggerlogr )msgargs r 9/opt/alt/python34/lib64/python3.4/multiprocessing/util.pyr + s c G s t r t j t | | n d S)N)r r DEBUG)r r r r r r / s c G s t r t j t | | n d S)N)r r INFO)r r r r r r 3 s c G s t r t j t | | n d S)N)r r r )r r r r r r 7 s c
C s d d l } | j z t s | j t a d t _ t t d rc t j t t j
t q t j j t f i f t j j
t f i f n Wd | j Xt S)z0
Returns logger used by multiprocessing
r N
unregister)loggingZ _acquireLockr Z getLogger LOGGER_NAMEZ propagatehasattratexitr _exit_functionregisterZ
_exithandlersremoveappendZ _releaseLock)r! r r r r ; s
c C sj d d l } t } | j t } | j } | j | | j | | r` | j | n d a t S)zB
Turn on logging and add a handler which prints to stderr
r NT)
r! r Z FormatterDEFAULT_LOGGING_FORMATZ
StreamHandlerZ setFormatterZ
addHandlerZsetLevel_log_to_stderrr )levelr! ZloggerZ formatterZhandlerr r r r
V s
c C s t j j j d } | d k r d d l } d d l } | j d d } t d | t d | j d | g d d | t j j d _finalizer_counter_keyosgetpid_pid_finalizer_registry)selfr; callbackr kwargsr. r r r __init__ s $ zFinalize.__init__c
C s y | | j =Wn t k
r, | d Yn X| j | k rR | d d } n4 | d | j | j | j | j | j | j } d | _ | _ | _ | _ | _ | Sd S)zQ
Run the callback unless it has already been called or cancelled
z finalizer no longer registeredz+finalizer ignored because different processNz/finalizer calling %s with args %s and kwargs %s)rK KeyErrorrN rG rH rI rF )rP wrrO r rM resr r r __call__ s
%zFinalize.__call__c C sL y t | j =Wn t k
r" Yn& Xd | _ | _ | _ | _ | _ d S)z3
Cancel finalization of the object
N)rO rK rT rF rG rH rI )rP r r r cancel s
zFinalize.cancelc C s
| j t k S)zS
Return whether this finalizer is still waiting to invoke callback
)rK rO )rP r r r still_active s zFinalize.still_activec
C s y | j } Wn t t f k
r0 d } Yn X| d k rA d Sd t | j d | j } | j r | d t | j 7} n | j r | d t | j 7} n | j d d k r | d t | j d 7} n | d S) Nzz ) rF AttributeError TypeErrorgetattrrG rH strrI rK )rP r; xr r r __repr__ s zFinalize.__repr__)
rZ
__module__ __qualname____doc__rS rO r rL rM rW rX rY ra r r r r r s c s t d k r d S d k r+ d d n f d d f d d t t j D } | j d d xW | D]O \ } } t d | y | Wqy t k
r d
d l } | j Yqy Xqy W d k r t j n d S) z
Run all finalizers whose exit priority is not None and at least minpriority
Finalizers with highest priority are called first; finalizers with
the same priority will be called in reverse order of creation.
Nc S s | d d d k S)Nr r )pr r r s z!_run_finalizers..c s& | d d d k o% | d d k S)Nr r )re ) minpriorityr r rf s c s" g | ] } | r | q Sr r ).0r` )fr r
s z#_run_finalizers..reverseTz
calling %sr ) rO r4 r6 r7 r r8 traceback print_excclear)rg r6 keyZ finalizerrl r )ri rg r _run_finalizers s %
rp c C s t p t d k S)z6
Returns true if the process is shutting down
N)_exitingr r r r r
s c C s t s d a | d | d | d | d k r x: | D]/ } | j rC | d | j | j j qC qC Wx. | D] } | d | j | j q Wn | d | n d S)NTzprocess shutting downz2running all "atexit" finalizers with priority >= 0r z!calling terminate() for daemon %sz calling join() for process %sz)running the remaining "atexit" finalizers)rq ZdaemonnameZ_popenZ terminatejoin)r r rp active_childrenr0 re r r r r% s
r% c @ s( e Z d Z d d Z d d Z d S)r c C s | j t | t j d S)N)_resetr r )rP r r r rS A s
z ForkAwareThreadLock.__init__c C s1 t j | _ | j j | _ | j j | _ d S)N) threadingZLock_lockacquirerelease)rP r r r ru E s zForkAwareThreadLock._resetN)rZ rb rc rS ru r r r r r @ s c @ s( e Z d Z d d Z d d Z d S)r c C s t | d d d S)Nc S s
| j j S)N)__dict__rn )r; r r r rf L s z)ForkAwareLocal.__init__..)r )rP r r r rS K s zForkAwareLocal.__init__c C s t | f f S)N)rA )rP r r r
__reduce__M s zForkAwareLocal.__reduce__N)rZ rb rc rS r{ r r r r r J s SC_OPEN_MAX c C s t | d t g } | j | d t k s< t d x> t t | d D]& } t j | | d | | d qS Wd S)Nr z fd too larger~ )r4 MAXFDr7 rC rangelenrL
closerange)Zfdsir r r r Y s
c C s d d l } t | } t j \ } } zM | j | t j | g d | d d d d d d d d
| | d d d SWd t j | t j | Xd S) Nr Tr Fr~ r~ r~ r~ r~ r~ )_posixsubprocesssortedrL pipeZ fork_execfsencodeclose)pathr Zpassfdsr Z errpipe_readZ
errpipe_writer r r spawnv_passfdsd s
r )3rL itertoolsrD r$ rv
subprocessr r __all__ZNOTSETr r r r r" r) r r* r r r r r r
r WeakValueDictionaryr5 countr? r= r rO rJ objectr rp r
rq rt r0 r% r& r Zlocalr sysconfr r8 r r r r r r
s` R$ (