| PythonTokenSource.java | Class | Python does not explicitly provide begin and end nesting signals.
Rather, the indentation level indicates when you begin and end.
This is an interesting lexical problem because multiple DEDENT
tokens should be sent to the parser sometimes without a corresponding
input symbol! Consider the following example:
a=1
if a>1:
print a
b=3
Here the "b" token on the left edge signals that a DEDENT is needed
after the "print a \n" and before the "b". |