3
\ @ s d Z dZddlZddlmZmZmZmZmZm Z ddl
m Z ddl
m Z G dd d e
Zd
d ZG d d
d
eZejejejddZdd Zdd Zdd ZdS )zPattern compiler.
The grammar is taken from PatternGrammar.txt.
The compiler compiles a pattern to a pytree.*Pattern instance.
z#Guido van Rossum N )driverliteralstokentokenizeparsegrammar)pytree)pygramc @ s e Zd ZdS )PatternSyntaxErrorN)__name__
__module__ __qualname__ r r '/usr/lib64/python3.6/lib2to3/patcomp.pyr s r c c sP t jt jt jh}tjtj| j}x(|D ] }|\}}}}}||kr(|V q(W dS )z6Tokenizes a string suppressing significant whitespace.N) r NEWLINEINDENTDEDENTr generate_tokensioStringIOreadline) inputskiptokensZ quintupletypevaluestartendZ line_textr r r tokenize_wrapper s
r c @ s: e Zd Zd
ddZdddZdd Zdd d
Zd d ZdS )PatternCompilerNc C sZ |dkrt j| _t j| _ntj|| _t j| j| _t j| _ t j
| _ tj | jt
d| _dS )z^Initializer.
Takes an optional alternative filename for the pattern grammar.
N)Zconvert)r
Zpattern_grammarr Zpattern_symbolssymsr Z load_grammarZSymbolsZpython_grammarZ pygrammarZpython_symbolspysymsZDriverpattern_convert)selfZ grammar_filer r r __init__( s
zPatternCompiler.__init__Fc C sn t |}y| jj||d}W n0 tjk
rL } ztt|W Y dd}~X nX |r`| j||fS | j|S dS )z=Compiles a pattern string to a nested pytree.*Pattern object.)debugN)r r Z parse_tokensr Z
ParseErrorr str compile_node)r$ r r& Z with_treer rooter r r compile_pattern7 s z PatternCompiler.compile_patternc
sV |j jjkr|jd }|j jjkrz fdd|jddd D }t|dkrX|d S tjdd |D ddd}|j S |j jj krʇ fd d|jD }t|dkr|d S tj|gddd}|j S |j jj
kr j |jdd }tj |}|j S d}|j}t|d
kr>|d j t
jkr>|d j}|dd }d}t|dkrx|d j jjkrx|d
}|dd } j ||}|dk r>|j} | d }
|
j t
jkrd} tj} nX|
j t
jkrd} tj} n>|
j t
jkr j| d } } t| d kr j| d
} n | dks"| dkr>|j }tj|gg| | d}|dk rN||_|j S )zXCompiles a node, recursively.
This is one big switch on the node type.
r c s g | ]} j |qS r )r( ).0ch)r$ r r
O s z0PatternCompiler.compile_node..N r c S s g | ]
}|gqS r r )r, ar r r r. R s )minmaxc s g | ]} j |qS r )r( )r, r- )r$ r r r. V s r5 r5 )r r! ZMatcherchildrenZ Alternativeslenr WildcardPatternoptimizeZ AlternativeZ NegatedUnit
compile_basicZNegatedPatternr EQUALr ZRepeaterSTARZHUGEPLUSLBRACEget_intname)
r$ nodeZaltspZunitspatternr@ nodesrepeatr6 Zchildr1 r2 r )r$ r r( C s^
"
z PatternCompiler.compile_nodec C s@ |d }|j tjkr4ttj|j}tjt ||S |j tj
kr|j}|j r|t krbt
d| |dd rvt
dtjt | S |dkrd }n,|jdst| j|d }|d krt
d| |dd r| j|d jd g}nd }tj||S nH|jdkr| j|d S |jd kr<| j|d }tj|ggddd
S d S ) Nr zInvalid token: %rr z Can't have details for tokenany_zInvalid symbol: %r([)r1 r2 )r r STRINGr' r Z
evalStringr r Z LeafPattern_type_of_literalNAMEisupper TOKEN_MAPr
startswithgetattrr" r( r6 Z NodePatternr8 )r$ rD rE rA r r Zcontent
subpatternr r r r: s8
z PatternCompiler.compile_basicc C s
t |jS )N)intr )r$ rA r r r r? s zPatternCompiler.get_int)N)FF)N)r r
r r% r+ r( r: r? r r r r r & s
G
#r )rL rJ NUMBERZTOKENc C s. | d j rtjS | tjkr&tj| S d S d S )Nr )isalphar rL r Zopmap)r r r r rK s
rK c C s> |\}}}}|s|| j kr*tj|||dS tj|||dS dS )z9Converts raw node information to a Node or Leaf instance.)contextN)Z
number2symbolr ZNodeZLeaf)r Z
raw_node_infor r rU r6 r r r r# s r# c C s t j| S )N)r r+ )rC r r r r+ s r+ )__doc__
__author__r Zpgen2r r r r r r r r
Exceptionr r objectr rL rJ rS rN rK r# r+ r r r r s