upstream/ipython Files · IPython/utils/tokenize2.py

Backport PR : don't 'restore_bytes' in from_JSON...

Backport PR : don't 'restore_bytes' in from_JSON It makes no sense to turn base64-encoded unicode strings into base64-encoded byte strings. I can't think why we do this, but we should be very careful about testing before merging this fix. fixes the issue tested in .

Thomas Kluyver - - Load All Authors

File last commit:

r10110:30fce8a6


                r12466:3ff9c5cf

Download file

             tokenize2.py
        
                    9 lines
            
             | 158 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / IPython / utils / tokenize2.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      """Load our patched versions of tokenize.

      """

      import sys

      if sys.version_info[0] >= 3:

          from _tokenize_py3 import *

      else:

          from _tokenize_py2 import *

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				"""Load our patched versions of tokenize.
				"""

				import sys

				if sys.version_info[0] >= 3:
				from _tokenize_py3 import *
				else:
				from _tokenize_py2 import *