upstream/ipython Files · IPython/utils/pyfile.py

Backport PR : Unicode content crashes the pager (console)...

Backport PR : Unicode content crashes the pager (console) We've run into an interesting bug in the astropy project. https://github.com/astropy/astropy/issues/600 When displaying a docstring that contains Unicode and is also long enough that it gets sent to the pager it fails since the docstring can't be sent to the pager as ascii. This crashes in the middle of sending content to the pager, so the shell ends up in an inconsistent state and stops echoing the keyboard etc. The fix (attached) is merely to encode the content sent to the pager in the same encoding as the terminal (`sys.stdout.encoding`). Strictly speaking, this isn't always the right thing to do, since the pager may be configured to expect a different encoding than the terminal, but that is sort of an irrational way to configure a machine... ;) For example, `less`, in the absence of any special environment variables to tell it otherwise, uses the standard `LC*` environment variables to determine what to do, which should be the same mechanism the terminal also uses by default. If anyone can suggest a better fix, I'm all for it. Perhaps it should be configurable, defaulting to `sys.stdout.encoding`?

Thomas - - Load All Authors

File last commit:

r5882:fd2691c8


                r9853:7f9a133e

Download file

             pyfile.py
        
                    23 lines
            
             | 840 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / IPython / utils / pyfile.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      """Utilities for working with Python source files.

      Exposes various functions from recent Python standard libraries, along with

      equivalents for older Python versions.

      """

      import os.path

      try:    # Python 3.2

          from imp import source_from_cache, cache_from_source

      except ImportError:

          # Python <= 3.1: .pyc files go next to .py

          def source_from_cache(path):

              basename, ext = os.path.splitext(path)

              if ext not in ('.pyc', '.pyo'):

                  raise ValueError('Not a cached Python file extension', ext)

              # Should we look for .pyw files?

              return basename + '.py'

          def cache_from_source(path, debug_override=None):

              if debug_override is None:

                  debug_override = __debug__

              basename, ext = os.path.splitext(path)

              return basename + '.pyc' if debug_override else '.pyo'

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				"""Utilities for working with Python source files.

				Exposes various functions from recent Python standard libraries, along with
				equivalents for older Python versions.
				"""
				import os.path

				try: # Python 3.2
				from imp import source_from_cache, cache_from_source
				except ImportError:
				# Python <= 3.1: .pyc files go next to .py
				def source_from_cache(path):
				basename, ext = os.path.splitext(path)
				if ext not in ('.pyc', '.pyo'):
				raise ValueError('Not a cached Python file extension', ext)
				# Should we look for .pyw files?
				return basename + '.py'

				def cache_from_source(path, debug_override=None):
				if debug_override is None:
				debug_override = __debug__
				basename, ext = os.path.splitext(path)
				return basename + '.pyc' if debug_override else '.pyo'