U
e5d @ s d Z dZddlZddlmZmZmZmZmZm Z ddl
m Z ddl
m Z G dd d e
Zd
d ZG d d
d
eZejejejddZdd Zdd Zdd ZdS )zPattern compiler.
The grammar is taken from PatternGrammar.txt.
The compiler compiles a pattern to a pytree.*Pattern instance.
z#Guido van Rossum N )driverliteralstokentokenizeparsegrammar)pytree)pygramc @ s e Zd ZdS )PatternSyntaxErrorN)__name__
__module__ __qualname__ r r '/usr/lib64/python3.8/lib2to3/patcomp.pyr s r c c sL t jt jt jh}tt| j}|D ] }|\}}}}}||kr&|V q&dS )z6Tokenizes a string suppressing significant whitespace.N) r NEWLINEINDENTDEDENTr generate_tokensioStringIOreadline) inputskiptokensZ quintupletypevaluestartendZ line_textr r r tokenize_wrapper s r c @ s: e Zd Zd
ddZdddZdd Zdd d
Zd d ZdS )PatternCompilerNc C sZ |dkrt j| _t j| _nt|| _t | j| _t j| _ t j
| _ tj | jt
d| _dS )z^Initializer.
Takes an optional alternative filename for the pattern grammar.
N)Zconvert)r
Zpattern_grammarr Zpattern_symbolssymsr Z load_grammarZSymbolsZpython_grammarZ pygrammarZpython_symbolspysymsZDriverpattern_convert)selfZ grammar_filer r r __init__( s
zPatternCompiler.__init__Fc
C sp t |}z| jj||d}W n2 tjk
rN } ztt|dW 5 d}~X Y nX |rb| ||fS | |S dS )z=Compiles a pattern string to a nested pytree.*Pattern object.)debugN)r r Z parse_tokensr Z
ParseErrorr str compile_node)r$ r r& Z with_treer rooter r r compile_pattern7 s z PatternCompiler.compile_patternc
sV |j jjkr|jd }|j jjkrz fdd|jddd D }t|dkrX|d S tjdd |D ddd}| S |j jj krʇ fd d|jD }t|dkr|d S tj|gddd}| S |j jj
kr |jdd }t |}| S d}|j}t|d
kr>|d j t
jkr>|d j}|dd }d}t|dkrx|d j jjkrx|d }|dd } ||}|dk r>|j} | d }
|
j t
jkrd} tj} nX|
j t
jkrd} tj} n>|
j t
jkr | d } } t| d kr | d
} n | dks"| dkr>| }tj|gg| | d}|dk rN||_| S )
zXCompiles a node, recursively.
This is one big switch on the node type.
r c s g | ]} |qS r r( .0Zchr$ r r
O s z0PatternCompiler.compile_node..N r c S s g | ]
}|gqS r r )r. ar r r r0 R s minmaxc s g | ]} |qS r r, r- r/ r r r0 V s )r r! ZMatcherchildrenZ Alternativeslenr WildcardPatternoptimizeZ AlternativeZ NegatedUnit
compile_basicZNegatedPatternr EQUALr ZRepeaterSTARZHUGEPLUSLBRACEget_intname)
r$ nodeZaltspZunitspatternrC nodesrepeatr9 Zchildr4 r5 r r/ r r( C s^
"
z PatternCompiler.compile_nodec C s@ |d }|j tjkr4tt|j}tt ||S |j tj
kr|j}| r|t krbt
d| |dd rvt
dtt | S |dkrd }n,|dst| j|d }|d krt
d| |dd r| |d jd g}nd }t||S nH|jdkr| |d S |jd kr<| |d }tj|ggddd
S d S ) Nr zInvalid token: %rr z Can't have details for tokenany_zInvalid symbol: %r([r3 )r r STRINGr' r Z
evalStringr r Z LeafPattern_type_of_literalNAMEisupper TOKEN_MAPr
startswithgetattrr" r( r9 Z NodePatternr; )r$ rG rH rD r r Zcontent
subpatternr r r r= s8
z PatternCompiler.compile_basicc C s
t |jS N)intr )r$ rD r r r rB s zPatternCompiler.get_int)N)FF)N)r r
r r% r+ r( r= rB r r r r r & s
G
#r )rO rM NUMBERZTOKENc C s. | d rtjS | tjkr&tj| S d S d S )Nr )isalphar rO r Zopmap)r r r r rN s
rN c C s> |\}}}}|s|| j kr*tj|||dS tj|||dS dS )z9Converts raw node information to a Node or Leaf instance.)contextN)Z
number2symbolr ZNodeZLeaf)r Z
raw_node_infor r rY r9 r r r r# s r# c C s t | S rU )r r+ )rF r r r r+ s r+ )__doc__
__author__r Zpgen2r r r r r r r r
Exceptionr r objectr rO rM rW rQ rN r# r+ r r r r s"