Ë
‚Ö¦i° ã ó® — d Z ddlZddlmZ G d„ de« ZdZi Zej « D ]$ Z e sŒe j « \ Z Z e
ee « ee < Œ& [ [ [ y)a‡ This module defines the data structures used to represent a grammar.
These are a bit arcane because they are derived from the data
structures used by Python's 'pgen' parser generator.
There's also a table here mapping operators to their names in the
token module; the Python tokenize module reports all operators as the
fallback token code OP, but the parser needs the actual token code.
é Né )Útokenc ó4 — e Zd ZdZd„ Zd„ Zd„ Zd„ Zd„ Zd„ Z y) ÚGrammara¶ Pgen parsing tables conversion class.
Once initialized, this class supplies the grammar tables for the
parsing engine implemented by parse.py. The parsing engine
accesses the instance variables directly. The class here does not
provide initialization of the tables; several subclasses exist to
do this (see the conv and pgen modules).
The load() method reads the tables from a pickle file, which is
much faster than the other ways offered by subclasses. The pickle
file is written by calling dump() (after loading the grammar
tables using a subclass). The report() method prints a readable
representation of the tables to stdout, for debugging.
The instance variables are as follows:
symbol2number -- a dict mapping symbol names to numbers. Symbol
numbers are always 256 or higher, to distinguish
them from token numbers, which are between 0 and
255 (inclusive).
number2symbol -- a dict mapping numbers to symbol names;
these two are each other's inverse.
states -- a list of DFAs, where each DFA is a list of
states, each state is a list of arcs, and each
arc is a (i, j) pair where i is a label and j is
a state number. The DFA number is the index into
this list. (This name is slightly confusing.)
Final states are represented by a special arc of
the form (0, j) where j is its own state number.
dfas -- a dict mapping symbol numbers to (DFA, first)
pairs, where DFA is an item from the states list
above, and first is a set of tokens that can
begin this grammar rule (represented by a dict
whose values are always 1).
labels -- a list of (x, y) pairs where x is either a token
number or a symbol number, and y is either None
or a string; the strings are keywords. The label
number is the index in this list; label numbers
are used to mark state transitions (arcs) in the
DFAs.
start -- the number of the grammar's start symbol.
keywords -- a dict mapping keyword strings to arc labels.
tokens -- a dict mapping token numbers to arc labels.
c ó„ — i | _ i | _ g | _ i | _ dg| _ i | _ i | _ i | _ d| _ y )N)r ÚEMPTYé ) Ú
symbol2numberÚ
number2symbolÚstatesÚdfasÚlabelsÚkeywordsÚtokensÚ symbol2labelÚstart)Úselfs ú./usr/lib64/python3.12/lib2to3/pgen2/grammar.pyÚ__init__zGrammar.__init__L sF € Ø ˆÔØ ˆÔ؈Œ ؈Œ Ø#nˆŒ ؈Œ
؈Œ Ø ˆÔ؈
ó c ó¤ — t |d« 5 }t j | j |t j « ddd« y# 1 sw Y yxY w)z)Dump the grammar tables to a pickle file.ÚwbN)ÚopenÚpickleÚdumpÚ__dict__ÚHIGHEST_PROTOCOL)r ÚfilenameÚfs r r z Grammar.dumpW s4 € ä
(˜DÔ
! QÜ K‰K˜Ÿ
™
q¬&×*AÑ*AÔ B÷ "×
!Ñ
!ús 0AÁAc ó¦ — t |d« 5 }t j |« }ddd« | j j « y# 1 sw Y Œ%xY w)z+Load the grammar tables from a pickle file.ÚrbN)r r Úloadr Úupdate)r r r Úds r r" z Grammar.load\ s; € ä
(˜DÔ
! QÜ— ‘ ˜A“ˆA÷ "à
‰
× Ñ ˜QÕ ÷ "Ð
!ús AÁAc ó` — | j j t j |« « y)z3Load the grammar tables from a pickle bytes object.N)r r# r Úloads)r Úpkls r r& z
Grammar.loadsb s € à
‰
× Ñ œVŸ\™\¨#Ó .Õ/r c óð — | j « }dD ]' }t ||t | |« j « « Œ) | j dd |_ | j
dd |_ | j |_ |S )z#
Copy the grammar.
)r
r r
r r r N)Ú __class__ÚsetattrÚgetattrÚcopyr r r )r ÚnewÚ dict_attrs r r, z Grammar.copyf sh € ð n‰nÓ ˆó4ˆIä C˜¤G¨D°)Ó$<×$AÑ$AÓ$CÕ Dð4ð —[‘[¡^ˆŒ
Ø—[‘[¡^ˆŒ
Ø—J‘JˆŒ ؈
r c ó^ — ddl m } t d« || j « t d« || j « t d« || j « t d« || j
« t d« || j « t d| j « y )
z:Dump the grammar tables to standard output, for debugging.r )ÚpprintÚs2nÚn2sr r
r r N)r0 Úprintr
r r r
r r )r r0 s r ÚreportzGrammar.reports sv € å!Ü
ˆeŒ Ùˆt×!Ñ!Ô"Ü
ˆeŒ Ùˆt×!Ñ!Ô"Ü
ˆhŒÙˆt{‰{ÔÜ
ˆfŒ
Ùˆty‰yÔÜ
ˆhŒÙˆt{‰{ÔÜ
ˆgt—z‘zÕ"r N)
Ú__name__Ú
__module__Ú __qualname__Ú__doc__r r r" r& r, r4 © r r r r s' „ ñ3òj òCò
ò 0ò ó
#r r a
( LPAR
) RPAR
[ LSQB
] RSQB
: COLON
, COMMA
; SEMI
+ PLUS
- MINUS
* STAR
/ SLASH
| VBAR
& AMPER
< LESS
> GREATER
= EQUAL
. DOT
% PERCENT
` BACKQUOTE
{ LBRACE
} RBRACE
@ AT
@= ATEQUAL
== EQEQUAL
!= NOTEQUAL
<> NOTEQUAL
<= LESSEQUAL
>= GREATEREQUAL
~ TILDE
^ CIRCUMFLEX
<< LEFTSHIFT
>> RIGHTSHIFT
** DOUBLESTAR
+= PLUSEQUAL
-= MINEQUAL
*= STAREQUAL
/= SLASHEQUAL
%= PERCENTEQUAL
&= AMPEREQUAL
|= VBAREQUAL
^= CIRCUMFLEXEQUAL
<<= LEFTSHIFTEQUAL
>>= RIGHTSHIFTEQUAL
**= DOUBLESTAREQUAL
// DOUBLESLASH
//= DOUBLESLASHEQUAL
-> RARROW
:= COLONEQUAL
)r8 r Ú r Úobjectr Ú opmap_rawÚopmapÚ
splitlinesÚlineÚsplitÚopÚnamer+ r9 r r ÚrC sp ðñ ó õ ôj#ˆfô j#ð^1
€ ðf €Ø × Ñ Ö "€DÚ Ø—:‘:“<‰ˆˆDÙ˜E 4Ó(ˆˆbŠ ð
#ð ˆ"‰dr