upstream/ipython Files · docs/examples/newparallel/demo/map.py

update API after sagedays29...

update API after sagedays29 tests, docs updated to match * Client no longer has high-level methods (only in Views) * module functions can be pushed * clients can have a connection timeout * dependencies have separate switches for success/failure, not just success_only * add `with view.temp_flags(**flags):` for temporary flags Also updated some docs and examples

MinRK - - Load All Authors

File last commit:

r3664:e90463ba


                r3664:e90463ba

Download file

             map.py
        
                    36 lines
            
             | 767 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / docs / examples / newparallel / demo / map.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      from IPython.zmq.parallel.client import *

      client = Client()

      view = client[:]

      @view.remote(block=True)

      def square(a):

          """return square of a number"""

          return a*a

      squares = map(square, range(42))

      # but that blocked between each result; not exactly useful

      square.block = False

      arlist = map(square, range(42))

      # submitted very fast

      # wait for the results:

      squares2 = [ r.get() for r in arlist ]

      # now the more convenient @parallel decorator, which has a map method:

      @view.parallel(block=False)

      def psquare(a):

          """return square of a number"""

          return a*a

      # this chunks the data into n-negines jobs, not 42 jobs:

      ar = psquare.map(range(42))

      # wait for the results to be done:

      squares3 = ar.get()

      print squares == squares2, squares3==squares

      # True

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				from IPython.zmq.parallel.client import *

				client = Client()
				view = client[:]

				@view.remote(block=True)
				def square(a):
				"""return square of a number"""
				return a*a

				squares = map(square, range(42))

				# but that blocked between each result; not exactly useful

				square.block = False

				arlist = map(square, range(42))
				# submitted very fast

				# wait for the results:
				squares2 = [ r.get() for r in arlist ]

				# now the more convenient @parallel decorator, which has a map method:

				@view.parallel(block=False)
				def psquare(a):
				"""return square of a number"""
				return a*a

				# this chunks the data into n-negines jobs, not 42 jobs:
				ar = psquare.map(range(42))

				# wait for the results to be done:
				squares3 = ar.get()

				print squares == squares2, squares3==squares
				# True