##// END OF EJS Templates
Reset the interactive namespace __warningregistry__ before executing code...
Reset the interactive namespace __warningregistry__ before executing code Fixes #6611. Idea: Right now, people often don't see important warnings when running code in IPython, because (to a first approximation) any given warning will only issue once per session. Blink and you'll miss it! This is a very common contributor to confused emails to numpy-discussion. E.g.: In [5]: 1 / my_array_with_random_contents /home/njs/.user-python2.7-64bit-3/bin/ipython:1: RuntimeWarning: divide by zero encountered in divide #!/home/njs/.user-python2.7-64bit-3/bin/python Out[5]: array([ 1.77073316, -2.29765021, -2.01800811, ..., 1.13871243, -1.08302964, -8.6185091 ]) Oo, right, guess I gotta be careful of those zeros -- thanks, numpy, for giving me that warning! A few days later: In [592]: 1 / some_other_array Out[592]: array([ 3.07735763, 0.50769289, 0.83984078, ..., -0.67563917, -0.85736257, -1.36511271]) Oops, it turns out that this array had a zero in it too, and that's going to bite me later. But no warning this time! The effect of this commit is to make it so that warnings triggered by the code in cell 5 do *not* suppress warnings triggered by the code in cell 592. Note that this only applies to warnings triggered *directly* by code entered interactively -- if somepkg.foo() calls anotherpkg.bad_func() which issues a warning, then this warning will still only be displayed once, even if multiple cells call somepkg.foo(). But if cell 5 and cell 592 both call anotherpkg.bad_func() directly, then both will get warnings. (Important exception: if foo() is defined *interactively*, and calls anotherpkg.bad_func(), then every cell that calls foo() will display the warning again. This is unavoidable without fixes to CPython upstream.) Explanation: Python's warning system has some weird quirks. By default, it tries to suppress duplicate warnings, where "duplicate" means the same warning message triggered twice by the same line of code. This requires determining which line of code is responsible for triggering a warning, and this is controlled by the stacklevel= argument to warnings.warn. Basically, though, the idea is that if foo() calls bar() which calls baz() which calls some_deprecated_api(), then baz() will get counted as being "responsible", and the warning system will make a note that the usage of some_deprecated_api() inside baz() has already been warned about and doesn't need to be warned about again. So far so good. To accomplish this, obviously, there has to be a record of somewhere which line this was. You might think that this would be done by recording the filename:linenumber pair in a dict inside the warnings module, or something like that. You would be wrong. What actually happens is that the warnings module will use stack introspection to reach into baz()'s execution environment, create a global (module-level) variable there named __warningregistry__, and then, inside this dictionary, record just the line number. Basically, it assumes that any given module contains only one line 1, only one line 2, etc., so storing the filename is irrelevant. Obviously for interactive code this is totally wrong -- all cells share the same execution environment and global namespace, and they all contain a new line 1. Currently the warnings module treats these as if they were all the same line. In fact they are not the same line; once we have executed a given chunk of code, we will never see those particular lines again. As soon as a given chunk of code finishes executing, its line number labels become meaningless, and the corresponding warning registry entries become meaningless as well. Therefore, with this patch we delete the __warningregistry__ each time we execute a new block of code.

File last commit:

r13603:0faf5d9f
r18548:61431d7d
Show More
magic_arguments.py
278 lines | 8.7 KiB | text/x-python | PythonLexer
/ IPython / core / magic_arguments.py
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 ''' A decorator-based method of constructing IPython magics with `argparse`
option handling.
New magic functions can be defined like so::
from IPython.core.magic_arguments import (argument, magic_arguments,
parse_argstring)
@magic_arguments()
@argument('-o', '--option', help='An optional argument.')
@argument('arg', type=int, help='An integer positional argument.')
def magic_cool(self, arg):
""" A really cool magic command.
"""
args = parse_argstring(magic_cool, arg)
...
The `@magic_arguments` decorator marks the function as having argparse arguments.
The `@argument` decorator adds an argument using the same syntax as argparse's
`add_argument()` method. More sophisticated uses may also require the
`@argument_group` or `@kwds` decorator to customize the formatting and the
parsing.
Help text for the magic is automatically generated from the docstring and the
arguments::
In[1]: %cool?
%cool [-o OPTION] arg
A really cool magic command.
positional arguments:
arg An integer positional argument.
optional arguments:
-o OPTION, --option OPTION
An optional argument.
Thomas Kluyver
Only include inheritance diagram where it's useful.
r8795 Inheritance diagram:
.. inheritance-diagram:: IPython.core.magic_arguments
:parts: 3
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 '''
#-----------------------------------------------------------------------------
Matthias BUSSONNIER
update copyright to 2011/20xx-2011...
r5390 # Copyright (C) 2010-2011, IPython Development Team.
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 #
# Distributed under the terms of the Modified BSD License.
#
# The full license is in the file COPYING.txt, distributed with this software.
#-----------------------------------------------------------------------------
Thomas Kluyver
Import argparse directly from stdlib
r12547 import argparse
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 import re
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
# Our own imports
from IPython.core.error import UsageError
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 from IPython.utils.decorators import undoc
Robert Kern
BUG: Use arg_split instead of shlex.split
r3292 from IPython.utils.process import arg_split
Bradley M. Froehle
magic_arguments: dedent but otherwise preserve indentation....
r7490 from IPython.utils.text import dedent
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 NAME_RE = re.compile(r"[a-zA-Z][a-zA-Z0-9_-]*$")
@undoc
Bradley M. Froehle
magic_arguments: dedent but otherwise preserve indentation....
r7490 class MagicHelpFormatter(argparse.RawDescriptionHelpFormatter):
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 """A HelpFormatter with a couple of changes to meet our needs.
Bradley M. Froehle
magic_arguments: dedent but otherwise preserve indentation....
r7490 """
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 # Modified to dedent text.
Bradley M. Froehle
magic_arguments: dedent but otherwise preserve indentation....
r7490 def _fill_text(self, text, width, indent):
return argparse.RawDescriptionHelpFormatter._fill_text(self, dedent(text), width, indent)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 # Modified to wrap argument placeholders in <> where necessary.
def _format_action_invocation(self, action):
if not action.option_strings:
metavar, = self._metavar_formatter(action, action.dest)(1)
return metavar
else:
parts = []
# if the Optional doesn't take a value, format is:
# -s, --long
if action.nargs == 0:
parts.extend(action.option_strings)
# if the Optional takes a value, format is:
# -s ARGS, --long ARGS
else:
default = action.dest.upper()
args_string = self._format_args(action, default)
# IPYTHON MODIFICATION: If args_string is not a plain name, wrap
# it in <> so it's valid RST.
if not NAME_RE.match(args_string):
args_string = "<%s>" % args_string
for option_string in action.option_strings:
parts.append('%s %s' % (option_string, args_string))
return ', '.join(parts)
# Override the default prefix ('usage') to our % magic escape,
# in a code block.
def add_usage(self, usage, actions, groups, prefix="::\n\n %"):
super(MagicHelpFormatter, self).add_usage(usage, actions, groups, prefix)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 class MagicArgumentParser(argparse.ArgumentParser):
""" An ArgumentParser tweaked for use by IPython magics.
"""
def __init__(self,
prog=None,
usage=None,
description=None,
epilog=None,
parents=None,
Bradley M. Froehle
magic_arguments: dedent but otherwise preserve indentation....
r7490 formatter_class=MagicHelpFormatter,
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 prefix_chars='-',
argument_default=None,
conflict_handler='error',
add_help=False):
if parents is None:
parents = []
super(MagicArgumentParser, self).__init__(prog=prog, usage=usage,
Andrew Spiers
Update IPython/core/magic_arguments.py...
r8295 description=description, epilog=epilog,
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 parents=parents, formatter_class=formatter_class,
prefix_chars=prefix_chars, argument_default=argument_default,
conflict_handler=conflict_handler, add_help=add_help)
def error(self, message):
""" Raise a catchable error instead of exiting.
"""
raise UsageError(message)
def parse_argstring(self, argstring):
""" Split a string into an argument list and parse that argument list.
"""
Robert Kern
BUG: Use arg_split instead of shlex.split
r3292 argv = arg_split(argstring)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 return self.parse_args(argv)
def construct_parser(magic_func):
""" Construct an argument parser using the function decorations.
"""
kwds = getattr(magic_func, 'argcmd_kwds', {})
if 'description' not in kwds:
kwds['description'] = getattr(magic_func, '__doc__', None)
arg_name = real_name(magic_func)
parser = MagicArgumentParser(arg_name, **kwds)
# Reverse the list of decorators in order to apply them in the
# order in which they appear in the source.
group = None
for deco in magic_func.decorators[::-1]:
result = deco.add_to_parser(parser, group)
if result is not None:
group = result
# Replace the magic function's docstring with the full help text.
Thomas Kluyver
Produce rst-compatible options lists from magic_arguments
r13603 magic_func.__doc__ = parser.format_help()
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
return parser
def parse_argstring(magic_func, argstring):
""" Parse the string of arguments for the given magic function.
"""
Fernando Perez
Simplify return form of some functions - avoid unnecessary variables.
r3431 return magic_func.parser.parse_argstring(argstring)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
def real_name(magic_func):
""" Find the real name of the magic.
"""
magic_name = magic_func.__name__
if magic_name.startswith('magic_'):
magic_name = magic_name[len('magic_'):]
Fernando Perez
Simplify return form of some functions - avoid unnecessary variables.
r3431 return getattr(magic_func, 'argcmd_name', magic_name)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
class ArgDecorator(object):
""" Base class for decorators to add ArgumentParser information to a method.
"""
def __call__(self, func):
if not getattr(func, 'has_arguments', False):
func.has_arguments = True
func.decorators = []
func.decorators.append(self)
return func
def add_to_parser(self, parser, group):
""" Add this object's information to the parser, if necessary.
"""
pass
class magic_arguments(ArgDecorator):
""" Mark the magic as having argparse arguments and possibly adjust the
name.
"""
def __init__(self, name=None):
self.name = name
def __call__(self, func):
if not getattr(func, 'has_arguments', False):
func.has_arguments = True
func.decorators = []
if self.name is not None:
func.argcmd_name = self.name
# This should be the first decorator in the list of decorators, thus the
# last to execute. Build the parser.
func.parser = construct_parser(func)
return func
Takafumi Arakaki
Refactor magic_arguments.py
r8427 class ArgMethodWrapper(ArgDecorator):
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
"""
Takafumi Arakaki
Refactor magic_arguments.py
r8427 Base class to define a wrapper for ArgumentParser method.
Child class must define either `_method_name` or `add_to_parser`.
"""
_method_name = None
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 def __init__(self, *args, **kwds):
self.args = args
self.kwds = kwds
def add_to_parser(self, parser, group):
""" Add this object's information to the parser.
"""
if group is not None:
parser = group
Takafumi Arakaki
Refactor magic_arguments.py
r8427 getattr(parser, self._method_name)(*self.args, **self.kwds)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 return None
Takafumi Arakaki
Refactor magic_arguments.py
r8427 class argument(ArgMethodWrapper):
""" Store arguments and keywords to pass to add_argument().
Takafumi Arakaki
Add new decorator magic_arguments.defaults
r8426
Instances also serve to decorate command methods.
"""
Takafumi Arakaki
Refactor magic_arguments.py
r8427 _method_name = 'add_argument'
Takafumi Arakaki
Add new decorator magic_arguments.defaults
r8426
Takafumi Arakaki
Refactor magic_arguments.py
r8427 class defaults(ArgMethodWrapper):
""" Store arguments and keywords to pass to set_defaults().
Takafumi Arakaki
Add new decorator magic_arguments.defaults
r8426
Takafumi Arakaki
Refactor magic_arguments.py
r8427 Instances also serve to decorate command methods.
"""
_method_name = 'set_defaults'
class argument_group(ArgMethodWrapper):
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229 """ Store arguments and keywords to pass to add_argument_group().
Instances also serve to decorate command methods.
"""
def add_to_parser(self, parser, group):
""" Add this object's information to the parser.
"""
Fernando Perez
Simplify return form of some functions - avoid unnecessary variables.
r3431 return parser.add_argument_group(*self.args, **self.kwds)
Robert Kern
ENH: Add the argparse-based option parsing for magics.
r3229
class kwds(ArgDecorator):
""" Provide other keywords to the sub-parser constructor.
"""
def __init__(self, **kwds):
self.kwds = kwds
def __call__(self, func):
func = super(kwds, self).__call__(func)
func.argcmd_kwds = self.kwds
return func
__all__ = ['magic_arguments', 'argument', 'argument_group', 'kwds',
'parse_argstring']