upstream/ipython Files · IPython/utils/tokenize2.py

Introduce some classes necessary fro Pygments refactor.

Thomas Kluyver - - Load All Authors

File last commit:

r13347:54891794


                r22109:93d4f03a

Download file

             tokenize2.py
        
                    9 lines
            
             | 160 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / IPython / utils / tokenize2.py
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Thomas Kluyver
    
Now include patched copies of tokenize for Python 2 and 3.

              r10110
            
      """Load our patched versions of tokenize.

      """

      import sys

      if sys.version_info[0] >= 3:

        Thomas Kluyver
    
Use explicit relative imports...

              r13347
            
          from ._tokenize_py3 import *

        Thomas Kluyver
    
Now include patched copies of tokenize for Python 2 and 3.

              r10110
            
      else:

        Thomas Kluyver
    
Use explicit relative imports...

              r13347
            
          from ._tokenize_py2 import *

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Thomas Kluyver Now include patched copies of tokenize for Python 2 and 3.	r10110	"""Load our patched versions of tokenize.
		"""

		import sys

		if sys.version_info[0] >= 3:
Thomas Kluyver Use explicit relative imports...	r13347	from ._tokenize_py3 import *
Thomas Kluyver Now include patched copies of tokenize for Python 2 and 3.	r10110	else:
Thomas Kluyver Use explicit relative imports...	r13347	from ._tokenize_py2 import *