B
fM @ s d Z ddlZed\ZZZZZedej ej
B j Z edej j
Zedej ejB j
Zedej j
Zedej j
Zed ej j
ZG d
d d eZeed d
Zedd dD edd dD edd dD G dd dZedkrddlm Z e ddd dS ) a Define partial Python code Parser used by editor and hyperparser.
Instances of ParseMap are used with str.translate.
The following bound search and match functions are defined:
_synchre - start of popular statement;
_junkre - whitespace or comment line;
_match_stringre: string, possibly without closer;
_itemre - line that may have bracket structure start;
_closere - line that must be followed by dedent.
_chew_ordinaryre - non-special characters.
N z
^
[ \t]*
(?: while
| else
| def
| return
| assert
| break
| class
| continue
| elif
| try
| except
| raise
| import
| yield
)
\b
z'
[ \t]*
(?: \# \S .* )?
\n
aK
\""" [^"\\]* (?:
(?: \\. | "(?!"") )
[^"\\]*
)*
(?: \""" )?
| " [^"\\\n]* (?: \\. [^"\\\n]* )* "?
| ''' [^'\\]* (?:
(?: \\. | '(?!'') )
[^'\\]*
)*
(?: ''' )?
| ' [^'\\\n]* (?: \\. [^'\\\n]* )* '?
zM
[ \t]*
[^\s#\\] # if we match, m.end()-1 is the interesting char
z_
\s*
(?: return
| break
| continue
| raise
| pass
)
\b
z
[^[\](){}#'"\\]+
c @ s e Zd ZdZdd ZdS )ParseMapap Dict subclass that maps anything not in dict to 'x'.
This is designed to be used with str.translate in study1.
Anything not specifically mapped otherwise becomes 'x'.
Example: replace everything except whitespace with 'x'.
>>> keepwhite = ParseMap((ord(c), ord(c)) for c in ' \t\n\r')
>>> "a + b\tc\nd".translate(keepwhite)
'x x x\tx\nx'
c C s dS )Nx )selfkeyr r 4/opt/alt/python37/lib64/python3.7/idlelib/pyparse.py __missing__r s zParseMap.__missing__N)__name__
__module__ __qualname____doc__r r r r r r f s
r r c c s | ]}t |t d fV qdS )(N)ord).0cr r r x s r z({[c c s | ]}t |t d fV qdS ))N)r )r r r r r r y s z)}]c c s | ]}t |t |fV qd S )N)r )r r r r r r z s z"'\
#c @ s| e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dd Z
dd Z dd Z dd Z
dd Zdd Zdd Zd S ) Parserc C s || _ || _d S )N) indentwidthtabwidth)r r r r r r __init__ s zParser.__init__c C s, t |dks |d dks t|| _d| _d S )Nr
)lenAssertionErrorcode study_level)r sr r r set_code s zParser.set_codec C s | j d }}t|}xdtdD ]X}|dd|}|dk r:P |dd|d }t|||}|rr|| sr| }P |}q W |dkrt|}|r|| s| }|S |d }x.t||}|r| \}}||s|}qP qW |S )a^
Return index of a good place to begin parsing, as close to the
end of the string as possible. This will be the start of some
popular stmt like "if" or "def". Return None if none found:
the caller should pass more prior context then, if possible, or
if not (the entire program text up until the point of interest
has already been tried) pass 0 to set_lo().
This will be reliable iff given a reliable is_char_in_string()
function, meaning that when it says "no", it's absolutely
guaranteed that the char is not in a string.
Nr z:
r r )r r rangerfind_synchrestartspan) r Zis_char_in_stringr poslimitZtriesimr r r r find_good_parse_start s4
z Parser.find_good_parse_startc C s: |dks | j |d dks t|dkr6| j |d | _ dS )zx Throw away the start of the string.
Intended to be called with the result of find_good_parse_start().
r r! r N)r r )r lor r r set_lo s z
Parser.set_loc
C s | j dkrdS d| _ | j}|t}|dd}|dd}|dd}|dd}|dd}t}d }}d g | _}|j}d t| }}x||k r|| } |d }| dkrq| dkr|d }|d kr|| q| d
kr|d }q| d kr |r|d }q| d ks| d
kr2| }
||d |d |
d kr>|
d }
|} t|
d } || }x||k r|| } |d }| dkrqX||d || |
kr|| }P | dkr|d }| d krX|d kr|| P qX| dkrX||k st || dkr|d }|d }qXqXW |d | kr,t
}qt }q| dkrV| d|}|d kst q| dksdt ||k srt || dkr|d }|d |krt
}|d }qW |t
kr|t kr|d krt}|| _|tk|d |kkst |d |kr|| dS )zFind the line numbers of non-continuation lines.
As quickly as humanly possible , find the line numbers (0-
based) of the non-continuation lines.
Creates self.{goodlines, continuation}.
r! NZxxxxxxxxxZxxxxZxxz
xr r r r "' \#r )r r translatetransreplaceC_NONE goodlinesappendr r C_STRING_FIRST_LINEC_STRING_NEXT_LINESfind C_BACKSLASH C_BRACKET continuation)
r r r@ levelZlnor9 Z push_goodr) nchZquoteZfirstlnowr r r _study1 s
zParser._study1c C s | | jS )N)rE r@ )r r r r get_continuation_typeO s z Parser.get_continuation_typec C s | j dkrdS | d| _ | j| j }}t|d }t|}x`|r|sLt|}x4t||d || D ]}|dd|d d }qhW t||r|d }q@P q@W |dkr|dkst|}|| | _ | _
d}g }|j } |dfg}
x||k rt |||} | rX|
} | d }x&||kr4|| dkr4|d }qW ||krH|| }| }||krXP || }
|
dkr| | |
|t|f |
}|d }q|
d kr|r|d
= |
}|d }|
|t|f q|
d ks|
d kr|
|t|d f |
}t|||
}|
|t|f q|
d
krn|
|t|d f |d||d }|dksZt|
|t|f q|
dks|t|d }||k st|| dkr|
|| }|d }qW || _|r|d
nd| _t|
| _dS )am
study1 was sufficient to determine the continuation status,
but doing more requires looking at every character. study2
does this for the last interesting statement in the block.
Creates:
self.stmt_start, stmt_end
slice indices of last interesting stmt
self.stmt_bracketing
the bracketing structure of the last interesting stmt; for
example, for the statement "say(boo) or die",
stmt_bracketing will be ((0, 0), (0, 1), (2, 0), (2, 1),
(4, 0)). Strings and comments are treated as brackets, for
the matter.
self.lastch
last interesting character before optional trailing comment
self.lastopenbracketpos
if continuation is C_BRACKET, index of last open bracket
r1 Nr! r r z
z([{z)]}r r/ r0 r4 r3 )r rE r r9 r r r" r# _junkre
stmt_startstmt_endr: _chew_ordinaryreend_match_stringrer= lastchlastopenbracketpostuplestmt_bracketing)r r r9 r) pqZnothingrN stackZ
push_stackZ
bracketingr* ZnewprC r r r _study2S s
zParser._study2c C s | | jtkst| j}| j}t|}|dd|d }}|d }xj||k rt||}|rt| d }d}P qJ|
d|d }}qJW | }}x|| dkr|d }qW | j }t||| | j
| S )zpReturn number of spaces the next line should be indented.
Line continuation must be C_BRACKET.
r r r! z )rU r@ r? r rO r r r# _itemrerL r= r
expandtabsr )r jr rB Zorigir) r* Zextrar r r compute_bracket_indent s&
z Parser.compute_bracket_indentc C s | | j}|d |d S )zReturn number of physical lines in last stmt.
The statement doesn't have to be an interesting statement. This is
intended to be called when continuation is C_BACKSLASH.
r )rE r9 )r r9 r r r get_num_lines_in_stmt s z Parser.get_num_lines_in_stmtc C s | | jtkst| j}| j}x|| dkr:|d }q$W |}|d|d }d }}x||k r&|| }|dkr|d }|d }qZ|dkr|r|d }|d }qZ|dks|dkrt||| }qZ|d krP qZ|dkr |d
kr |dks||d d kr ||d d
kr d}P qZ|d }qZW |rN|d }t
d ||| d
k}|sv|}x || dkrt|d }qZW t || j| | j
d S )zReturn number of spaces the next line should be indented.
Line continuation must be C_BACKSLASH. Also assume that the new
line is the first one following the initial line of the stmt.
z r! r r z([{z)]}r/ r0 r4 =z=<>!z\s*\\Nz
)rU r@ r> r r rI r= rM rL rematchr rW r )r r r) startposendposfoundrA rC r r r compute_backslash_indent sJ
z Parser.compute_backslash_indentc C sN | | j| j }}|}| j}x ||k r@|| dkr@|d }q"W ||| S )z`Return the leading whitespace on the initial line of the last
interesting stmt.
z r! )rU rI rJ r )r r) rB rX r r r r get_base_indent_string0 s z Parser.get_base_indent_stringc C s | | jdkS )z r; r< r? compileVERBOSE MULTILINEsearchr$ r^ rH DOTALLrM rV rf rK dictr fromkeysr6 updater r
Zunittestrj r r r r s4 U