upstream/ipython Files · docs/examples/kernel/taskmap.py

Initial version of working refactored ipcluster....

Initial version of working refactored ipcluster. This new version uses Twisted's cross platform process management API and provides: * New command line parsing using argparse. This allows for different subcommands (ipcluster local, ipcluster pbs, ipcluster mpirun, etc). * Currently working local and mpirun stating of clusters. * Almost working pbs starting. This has no docs and no tests as of yet and should be considered a tech preview.

Brian E Granger - - Load All Authors

File last commit:

r1395:1feaf0a3


                r1770:49f63bba

Download file

             taskmap.py
        
                    18 lines
            
             | 490 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / docs / examples / kernel / taskmap.py
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Brian E Granger
    
The refactoring of the Task system is nearly complete.  Now there are...

              r1395
            
      from IPython.kernel import client

      tc = client.TaskClient()

      result = tc.map(lambda x: 2*x, range(10))

      print "Simple, default map: ", result

      m = tc.mapper(block=False, clear_after=True, clear_before=True)

      tids = m.map(lambda x: 2*x, range(10))

      print "Submitted tasks, got ids: ", tids

      tc.barrier(tids)

      result = [tc.get_task_result(tid) for tid in tids]

      print "Using a mapper: ", result

      @tc.parallel()

      def f(x): return 2*x

      result = f(range(10))

      print "Using a parallel function: ", result

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Brian E Granger The refactoring of the Task system is nearly complete. Now there are...	r1395	from IPython.kernel import client

		tc = client.TaskClient()

		result = tc.map(lambda x: 2*x, range(10))
		print "Simple, default map: ", result

		m = tc.mapper(block=False, clear_after=True, clear_before=True)
		tids = m.map(lambda x: 2*x, range(10))
		print "Submitted tasks, got ids: ", tids
		tc.barrier(tids)
		result = [tc.get_task_result(tid) for tid in tids]
		print "Using a mapper: ", result

		@tc.parallel()
		def f(x): return 2*x

		result = f(range(10))
		print "Using a parallel function: ", result