upstream/ipython Files · docs/examples/parallel/multiengine2.py

Merge pull request from minrk/parallel_wait...

Merge pull request from minrk/parallel_wait improve patience for slow Hub in client tests adds a first step in `_wait_for_idle`, where it waits for all tasks to arrive before waiting for no tasks to be running. On a super slow machine, it was possible for `_wait_for_idle` to return prematurely, before tasks had even started. closes

Thomas Kluyver - - Load All Authors

File last commit:

r6455:15863dc1


                r9181:9db88115

Download file

             multiengine2.py
        
                    29 lines
            
             | 794 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / docs / examples / parallel / multiengine2.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #-------------------------------------------------------------------------------

      # Imports

      #-------------------------------------------------------------------------------

      from __future__ import print_function

      import time

      from IPython.parallel import Client

      #-------------------------------------------------------------------------------

      # Setup

      #-------------------------------------------------------------------------------

      mux = Client()[:]

      mux.clear()

      mux.block=False

      ar1 = mux.apply(time.sleep, 5)

      ar2 = mux.push(dict(a=10,b=30,c=range(20000),d='The dog went swimming.'))

      ar3 = mux.pull(('a','b','d'), block=False)

      print("Try a non-blocking get_result")

      ar4 = mux.get_result()

      print("Now wait for all the results")

      mux.wait([ar1,ar2,ar3,ar4])

      print("The last pull got:", ar4.r)

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#-------------------------------------------------------------------------------
				# Imports
				#-------------------------------------------------------------------------------
				from __future__ import print_function

				import time

				from IPython.parallel import Client

				#-------------------------------------------------------------------------------
				# Setup
				#-------------------------------------------------------------------------------

				mux = Client()[:]

				mux.clear()

				mux.block=False

				ar1 = mux.apply(time.sleep, 5)
				ar2 = mux.push(dict(a=10,b=30,c=range(20000),d='The dog went swimming.'))
				ar3 = mux.pull(('a','b','d'), block=False)

				print("Try a non-blocking get_result")
				ar4 = mux.get_result()

				print("Now wait for all the results")
				mux.wait([ar1,ar2,ar3,ar4])
				print("The last pull got:", ar4.r)