3
\ @ s d Z dZddgZddlZddlZddlZddlZddlZddlZddl m
Z
m Z m Z m
Z
mZ G dd deZd d
ZdddZdd Zdd Zdd Zedkrejee dS )zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum Driver load_grammar N )grammarparsetokentokenizepgenc @ sH e Zd ZdddZdddZdddZdd d
Zdd d Zdd
dZdS )r Nc C s& || _ |d krtj }|| _|| _d S )N)r logging getLoggerloggerconvert)selfr r
r r ,/usr/lib64/python3.6/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C sv t j| j| j}|j d}d}d } } } } }
d} x4|D ]} | \}}}} }
|||fkr|\}
}||
k r| d|
| 7 } |
}d}||k r| |
|| 7 } |}|tjtjfkr| |7 } | \}}|jdr@|d7 }d}q@|t j
krtj | }|r| j j
dt j| || |j||| |fr6|r4| j j
d P d} | \}}|jdr@|d7 }d}q@W t jd||| |f|jS ) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
Zsetupr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens' sR
zDriver.parse_tokensc C s t j|j}| j||S )z*Parse a stream and return the syntax tree.)r generate_tokensreadliner# )r streamr r r r r parse_stream_rawW s zDriver.parse_stream_rawc C s | j ||S )z*Parse a stream and return the syntax tree.)r' )r r& r r r r parse_stream\ s zDriver.parse_streamc
C s* t j|d|}z | j||S |j X dS )z(Parse a file and return the syntax tree.rN)codecsopenr( close)r filenameencodingr r& r r r
parse_file` s zDriver.parse_filec C s t jtj|j}| j||S )z*Parse a string and return the syntax tree.)r r$ ioStringIOr% r# )r textr r r r r parse_stringh s zDriver.parse_string)NN)F)F)F)NF)F) __name__
__module__ __qualname__r r# r' r( r/ r3 r r r r r s
0
c C s: t jj| \}}|dkr d}|| djtttj d S )Nz.txtr .z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailr r r _generate_pickle_namen s rC Grammar.txtTFc C s |dkrt j }|dkr t| n|}|s4t|| r|jd| tj| }|r|jd| y|j| W q tk
r } z|jd| W Y dd}~X qX nt j
}|j | |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rC _newerinfor Zgenerate_grammardumpOSErrorr Grammarload)r@ Zgpsaveforcer ger r r r u s
c C s8 t jj| sdS t jj|s dS t jj| t jj|kS )z0Inquire whether file a was written since file b.FT)r8 r9 existsgetmtime)abr r r rE s
rE c C sF t jj|rt|S tt jj|}tj| |}tj }|j
| |S )a Normally, loads a pickled grammar by doing
pkgutil.get_data(package, pickled_grammar)
where *pickled_grammar* is computed from *grammar_source* by adding the
Python version and using a ``.pickle`` extension.
However, if *grammar_source* is an extant file, load_grammar(grammar_source)
is called instead. This facilitates using a packaged grammar file when needed
but preserves load_grammar's automatic regeneration behavior when possible.
) r8 r9 isfiler rC basenamepkgutilget_datar rI loads)packageZgrammar_sourceZ pickled_namedatarM r r r load_packaged_grammar s
rZ c G sF | st jdd } tjtjt jdd x| D ]}t|ddd q,W dS )zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nz %(message)s)levelr& formatT)rK rL )r> argvr
Z basicConfigINFOstdoutr )argsr@ r r r main s
ra __main__)rD NTFN)__doc__
__author____all__r* r0 r8 r
rU r> r r r r r r objectr rC r rE rZ ra r4 exitintr r r r s$ P