##// END OF EJS Templates
Backport PR #2738: Unicode content crashes the pager (console)...
Backport PR #2738: Unicode content crashes the pager (console) We've run into an interesting bug in the astropy project. https://github.com/astropy/astropy/issues/600 When displaying a docstring that contains Unicode and is also long enough that it gets sent to the pager it fails since the docstring can't be sent to the pager as ascii. This crashes in the middle of sending content to the pager, so the shell ends up in an inconsistent state and stops echoing the keyboard etc. The fix (attached) is merely to encode the content sent to the pager in the same encoding as the terminal (`sys.stdout.encoding`). Strictly speaking, this isn't always the right thing to do, since the pager may be configured to expect a different encoding than the terminal, but that is sort of an irrational way to configure a machine... ;) For example, `less`, in the absence of any special environment variables to tell it otherwise, uses the standard `LC*` environment variables to determine what to do, which should be the same mechanism the terminal also uses by default. If anyone can suggest a better fix, I'm all for it. Perhaps it should be configurable, defaulting to `sys.stdout.encoding`?

File last commit:

r5390:c82649ea
r9853:7f9a133e
Show More
codeutil.py
42 lines | 1.6 KiB | text/x-python | PythonLexer
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557 # encoding: utf-8
"""Utilities to enable code objects to be pickled.
Any process that import this module will be able to pickle code objects. This
Bernardo B. Marques
remove all trailling spaces
r4872 includes the func_code attribute of any function. Once unpickled, new
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557 functions can be built using new.function(code, globals()). Eventually
we need to automate all of this so that functions themselves can be pickled.
Reference: A. Tremols, P Cogolo, "Python Cookbook," p 302-305
"""
__docformat__ = "restructuredtext en"
#-------------------------------------------------------------------------------
Matthias BUSSONNIER
update copyright to 2011/20xx-2011...
r5390 # Copyright (C) 2008-2011 The IPython Development Team
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557 #
# Distributed under the terms of the BSD License. The full license is in
# the file COPYING, distributed as part of this software.
#-------------------------------------------------------------------------------
#-------------------------------------------------------------------------------
# Imports
#-------------------------------------------------------------------------------
MinRK
update parallel code for py3k...
r4155 import sys
MinRK
cleanup per review...
r4161 import types, copy_reg
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557
def code_ctor(*args):
MinRK
cleanup per review...
r4161 return types.CodeType(*args)
Bernardo B. Marques
remove all trailling spaces
r4872
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557 def reduce_code(co):
if co.co_freevars or co.co_cellvars:
raise ValueError("Sorry, cannot pickle code objects with closures")
MinRK
update parallel code for py3k...
r4155 args = [co.co_argcount, co.co_nlocals, co.co_stacksize,
co.co_flags, co.co_code, co.co_consts, co.co_names,
co.co_varnames, co.co_filename, co.co_name, co.co_firstlineno,
co.co_lnotab]
if sys.version_info[0] >= 3:
args.insert(1, co.co_kwonlyargcount)
return code_ctor, tuple(args)
MinRK
codeutil into zmq, to prevent IPython.kernel import
r3557
copy_reg.pickle(types.CodeType, reduce_code)