upstream/ipython Files · IPython/extensions/tests/test_cythonmagic.py

Backport PR : Unicode content crashes the pager (console)...

Backport PR : Unicode content crashes the pager (console) We've run into an interesting bug in the astropy project. https://github.com/astropy/astropy/issues/600 When displaying a docstring that contains Unicode and is also long enough that it gets sent to the pager it fails since the docstring can't be sent to the pager as ascii. This crashes in the middle of sending content to the pager, so the shell ends up in an inconsistent state and stops echoing the keyboard etc. The fix (attached) is merely to encode the content sent to the pager in the same encoding as the terminal (`sys.stdout.encoding`). Strictly speaking, this isn't always the right thing to do, since the pager may be configured to expect a different encoding than the terminal, but that is sort of an irrational way to configure a machine... ;) For example, `less`, in the absence of any special environment variables to tell it otherwise, uses the standard `LC*` environment variables to determine what to do, which should be the same mechanism the terminal also uses by default. If anyone can suggest a better fix, I'm all for it. Perhaps it should be configurable, defaulting to `sys.stdout.encoding`?

Fernando Perez - - Load All Authors

File last commit:

r7425:4aeb2e27


                r9853:7f9a133e

Download file

             test_cythonmagic.py
        
                    58 lines
            
             | 1.2 KiB
            
                | text/x-python
            
             |
                PythonLexer
            
             / IPython / extensions / tests / test_cythonmagic.py
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Brian Granger
    
Adding simple tests for the Cython magics extension.

              r7035
            
      # -*- coding: utf-8 -*-

      """Tests for the Cython magics extension."""

      import os

      import nose.tools as nt

        Fernando Perez
    
Skip external libs test on Windows, we can't seem to make it build there.

              r7425
            
      from IPython.testing import decorators as dec

        Brian Granger
    
More code review changes:...

              r7102
            
      from IPython.utils import py3compat

        Brian Granger
    
Adding simple tests for the Cython magics extension.

              r7035
            
        Brian Granger
    
More code review changes:...

              r7102
            
      code = py3compat.str_to_unicode("""def f(x):

        Brian Granger
    
Adding simple tests for the Cython magics extension.

              r7035
            
          return 2*x

        Brian Granger
    
More code review changes:...

              r7102
            
      """)

        Brian Granger
    
Adding simple tests for the Cython magics extension.

              r7035
            
      try:

          import Cython

      except:

        Brian Granger
    
Using better approach for skipping test if Cython no pres.

              r7036
            
          __test__ = False

        Fernando Perez
    
Add test for external library linking.

              r7420
            
      ip = get_ipython()

        Brian Granger
    
Using better approach for skipping test if Cython no pres.

              r7036
            
      def setup():

          ip.extension_manager.load_extension('cythonmagic')

        Fernando Perez
    
Add test for external library linking.

              r7420
            
        Brian Granger
    
Using better approach for skipping test if Cython no pres.

              r7036
            
      def test_cython_inline():

          ip.ex('a=10; b=20')

          result = ip.run_cell_magic('cython_inline','','return a+b')

          nt.assert_equals(result, 30)

        Fernando Perez
    
Add test for external library linking.

              r7420
            
        Brian Granger
    
Using better approach for skipping test if Cython no pres.

              r7036
            
      def test_cython_pyximport():

          module_name = '_test_cython_pyximport'

          ip.run_cell_magic('cython_pyximport', module_name, code)

          ip.ex('g = f(10)')

          nt.assert_equals(ip.user_ns['g'], 20.0)

          try:

              os.remove(module_name+'.pyx')

          except OSError:

              pass

        Fernando Perez
    
Add test for external library linking.

              r7420
            
        Brian Granger
    
Using better approach for skipping test if Cython no pres.

              r7036
            
      def test_cython():

          ip.run_cell_magic('cython', '', code)

          ip.ex('g = f(10)')

        Brian Granger
    
More code review changes:...

              r7102
            
          nt.assert_equals(ip.user_ns['g'], 20.0)

        Brian Granger
    
Adding simple tests for the Cython magics extension.

              r7035
            
        Fernando Perez
    
Skip external libs test on Windows, we can't seem to make it build there.

              r7425
            
      @dec.skip_win32

        Fernando Perez
    
Add test for external library linking.

              r7420
            
      def test_extlibs():

          code = py3compat.str_to_unicode("""

      from libc.math cimport sin

      x = sin(0.0)

          """)

          ip.user_ns['x'] = 1

          ip.run_cell_magic('cython', '-l m', code)

          nt.assert_equals(ip.user_ns['x'], 0)

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Brian Granger Adding simple tests for the Cython magics extension.	r7035	# -- coding: utf-8 --
		"""Tests for the Cython magics extension."""

		import os
		import nose.tools as nt

Fernando Perez Skip external libs test on Windows, we can't seem to make it build there.	r7425	from IPython.testing import decorators as dec
Brian Granger More code review changes:...	r7102	from IPython.utils import py3compat
Brian Granger Adding simple tests for the Cython magics extension.	r7035
Brian Granger More code review changes:...	r7102	code = py3compat.str_to_unicode("""def f(x):
Brian Granger Adding simple tests for the Cython magics extension.	r7035	return 2*x
Brian Granger More code review changes:...	r7102	""")
Brian Granger Adding simple tests for the Cython magics extension.	r7035
		try:
		import Cython
		except:
Brian Granger Using better approach for skipping test if Cython no pres.	r7036	__test__ = False

Fernando Perez Add test for external library linking.	r7420	ip = get_ipython()


Brian Granger Using better approach for skipping test if Cython no pres.	r7036	def setup():
		ip.extension_manager.load_extension('cythonmagic')

Fernando Perez Add test for external library linking.	r7420
Brian Granger Using better approach for skipping test if Cython no pres.	r7036	def test_cython_inline():
		ip.ex('a=10; b=20')
		result = ip.run_cell_magic('cython_inline','','return a+b')
		nt.assert_equals(result, 30)

Fernando Perez Add test for external library linking.	r7420
Brian Granger Using better approach for skipping test if Cython no pres.	r7036	def test_cython_pyximport():
		module_name = '_test_cython_pyximport'
		ip.run_cell_magic('cython_pyximport', module_name, code)
		ip.ex('g = f(10)')
		nt.assert_equals(ip.user_ns['g'], 20.0)
		try:
		os.remove(module_name+'.pyx')
		except OSError:
		pass

Fernando Perez Add test for external library linking.	r7420
Brian Granger Using better approach for skipping test if Cython no pres.	r7036	def test_cython():
		ip.run_cell_magic('cython', '', code)
		ip.ex('g = f(10)')
Brian Granger More code review changes:...	r7102	nt.assert_equals(ip.user_ns['g'], 20.0)
Brian Granger Adding simple tests for the Cython magics extension.	r7035
Fernando Perez Skip external libs test on Windows, we can't seem to make it build there.	r7425
		@dec.skip_win32
Fernando Perez Add test for external library linking.	r7420	def test_extlibs():
		code = py3compat.str_to_unicode("""
		from libc.math cimport sin
		x = sin(0.0)
		""")
		ip.user_ns['x'] = 1
		ip.run_cell_magic('cython', '-l m', code)
		nt.assert_equals(ip.user_ns['x'], 0)