upstream/ipython Files · examples/parallel/workflow/job_wrapper.py

Merge pull request from minrk/even-more-ways-to-get-ifaces...

Merge pull request from minrk/even-more-ways-to-get-ifaces Add even more ways to populate localinterfaces use netifaces for faster IPython.utils.localinterfaces when availlable, Parse subprocess output from ifconfig / ip addr / ipconfig. Lower priority than netifaces, but still higher priority than socket.gethostbyname. Fallback to gethostname otherwise. Should be much faster in worst case scenario where machine are badly configurred and can wait up to ~30s to start ipython. Slighly slower in other cases.

Brian Granger - - Load All Authors

File last commit:

r9190:20a102a5


                r12911:aeeb7f5a

Download file

             job_wrapper.py
        
                    25 lines
            
             | 542 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / examples / parallel / workflow / job_wrapper.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #!/usr/bin/env python

      """Python wrapper around a submitted workflow job.

      In reality this would be a more sophisticated script, here we only illustrate

      the basic idea by considering that a submitted 'job' is a Python string to be

      executed.

      """

      import sys

      argv = sys.argv

      from IPython.parallel.engine import EngineFactory

      from IPython.parallel.ipengineapp import launch_new_instance

      ns = {}

      # job

      exec sys.argv[1] in ns

      # this should really use Config:

      EngineFactory.user_ns = ns

      # start engine with job namespace

      launch_new_instance()

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#!/usr/bin/env python
				"""Python wrapper around a submitted workflow job.

				In reality this would be a more sophisticated script, here we only illustrate
				the basic idea by considering that a submitted 'job' is a Python string to be
				executed.
				"""

				import sys

				argv = sys.argv

				from IPython.parallel.engine import EngineFactory
				from IPython.parallel.ipengineapp import launch_new_instance

				ns = {}

				# job
				exec sys.argv[1] in ns

				# this should really use Config:
				EngineFactory.user_ns = ns

				# start engine with job namespace
				launch_new_instance()