j f! @ s d Z d Z d d g Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m
Z
m Z m Z m
Z
Gd d d e Z d d d
d d d d Z d
d Z d d Z e d k r e j e e n d S)zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum Driver load_grammar N )grammarparsetokentokenizepgenc @ sp e Z d Z d d d d Z d d d Z d d d Z d d d
Z d d d d Z d d
d Z d S)r Nc C s: | | _ | d k r$ t j } n | | _ | | _ d S)N)r logging getLoggerloggerconvert)selfr r
r r 9/opt/alt/python34/lib64/python3.4/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C s@ t j | j | j } | j d } d } d } } } } }
d } x| D]} | \ } } } } }
| | | f k r
| | f | k s t | | f | f | \ }
} | |
k r | d |
| 7} |
} d } n | | k r
| |
| | 7} | } q
n | t j t j f k rc| | 7} | \ } } | j d rQ | d 7} d } qQ qQ n | t
j k rt j | } n | r| j
j d t
j | | | n | j | | | | f r| r| j
j d n Pn d } | \ } } | j d rQ | d 7} d } qQ qQ Wt j d | | | | f | j S) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
ZsetupAssertionErrorr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens& sT
*
zDriver.parse_tokensc C s" t j | j } | j | | S)z*Parse a stream and return the syntax tree.)r generate_tokensreadliner$ )r streamr r r r r parse_stream_rawV s zDriver.parse_stream_rawc C s | j | | S)z*Parse a stream and return the syntax tree.)r( )r r' r r r r parse_stream[ s zDriver.parse_streamc
C s; t j | d | } z | j | | SWd | j Xd S)z(Parse a file and return the syntax tree.rN)codecsopenr) close)r filenameencodingr r' r r r
parse_file_ s zDriver.parse_filec C s+ t j t j | j } | j | | S)z*Parse a string and return the syntax tree.)r r% ioStringIOr& r$ )r textr r r r r parse_stringg s zDriver.parse_string) __name__
__module__ __qualname__r r$ r( r) r0 r4 r r r r r s 0z Grammar.txtTFc C s< | d k r t j } n | d k r~ t j j | \ } } | d k rT d } n | | d j t t t j d } n | s t
| | r | j d | t j
| } | r8| j d | y | j | Wq t k
r} z | j d t | WYd d } ~ Xq Xq8n t j } | j | | S) z'Load the grammar (maybe from a pickle).Nz.txtr .z.picklez!Generating grammar tables from %sz Writing grammar tables to %szWriting failed:)r
r ospathsplitextjoinmapstrsys version_info_newerinfor Zgenerate_grammardumpOSErrorr ZGrammarload) gtZgpsaveforcer headtailger r r r m s& *0
c C sN t j j | s d St j j | s, d St j j | t j j | k S)z0Inquire whether file a was written since file b.FT)r9 r: existsgetmtime)abr r r rA s
rA c G si | s t j d d } n t j d t j d t j d d x$ | D] } t | d d d d qE Wd S)
zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nlevelr' formatz %(message)srG TrH )r? argvr
Z basicConfigINFOstdoutr )argsrF r r r main s
rW __main__)__doc__
__author____all__r+ r1 r9 r
r? r r r r r r objectr r rA rW r5 exitintr r r r s (P