upstream/ipython Files · examples/parallel/taskmap.py

Merge pull request from minrk/even-more-ways-to-get-ifaces...

Merge pull request from minrk/even-more-ways-to-get-ifaces Add even more ways to populate localinterfaces use netifaces for faster IPython.utils.localinterfaces when availlable, Parse subprocess output from ifconfig / ip addr / ipconfig. Lower priority than netifaces, but still higher priority than socket.gethostbyname. Fallback to gethostname otherwise. Should be much faster in worst case scenario where machine are badly configurred and can wait up to ~30s to start ipython. Slighly slower in other cases.

Brian Granger - - Load All Authors

File last commit:

r9190:20a102a5


                r12911:aeeb7f5a

Download file

             taskmap.py
        
                    36 lines
            
             | 636 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / examples / parallel / taskmap.py
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
      # <nbformat>2</nbformat>

      # <markdowncell>

      # # Load balanced map and parallel function decorator

      # <codecell>

        Thomas Kluyver
    
Update print syntax in parallel examples.

              r6455
            
      from __future__ import print_function

        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
        MinRK
    
translate last remaining old parallel examples

              r3690
            
      from IPython.parallel import Client

        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
      # <codecell>

        MinRK
    
translate last remaining old parallel examples

              r3690
            
      rc = Client()

      v = rc.load_balanced_view()

        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
      # <codecell>

        MinRK
    
translate last remaining old parallel examples

              r3690
            
      result = v.map(lambda x: 2*x, range(10))

        Thomas Kluyver
    
Update print syntax in parallel examples.

              r6455
            
      print("Simple, default map: ", list(result))

        MinRK
    
translate last remaining old parallel examples

              r3690
            
        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
      # <codecell>

        MinRK
    
translate last remaining old parallel examples

              r3690
            
      ar = v.map_async(lambda x: 2*x, range(10))

        Thomas Kluyver
    
Update print syntax in parallel examples.

              r6455
            
      print("Submitted tasks, got ids: ", ar.msg_ids)

        MinRK
    
translate last remaining old parallel examples

              r3690
            
      result = ar.get()

        Thomas Kluyver
    
Update print syntax in parallel examples.

              r6455
            
      print("Using a mapper: ", result)

        MinRK
    
translate last remaining old parallel examples

              r3690
            
        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581
            
      # <codecell>

        MinRK
    
translate last remaining old parallel examples

              r3690
            
      @v.parallel(block=True)

      def f(x): return 2*x

      result = f.map(range(10))

        Thomas Kluyver
    
Update print syntax in parallel examples.

              r6455
            
      print("Using a parallel function: ", result)

        Brian E. Granger
    
Reworking parallel examples as notebooks.

              r4581

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Brian E. Granger Reworking parallel examples as notebooks.	r4581	# <nbformat>2</nbformat>

		# <markdowncell>

		# # Load balanced map and parallel function decorator

		# <codecell>
Thomas Kluyver Update print syntax in parallel examples.	r6455	from __future__ import print_function
Brian E. Granger Reworking parallel examples as notebooks.	r4581
MinRK translate last remaining old parallel examples	r3690	from IPython.parallel import Client

Brian E. Granger Reworking parallel examples as notebooks.	r4581	# <codecell>

MinRK translate last remaining old parallel examples	r3690	rc = Client()
		v = rc.load_balanced_view()

Brian E. Granger Reworking parallel examples as notebooks.	r4581	# <codecell>

MinRK translate last remaining old parallel examples	r3690	result = v.map(lambda x: 2*x, range(10))
Thomas Kluyver Update print syntax in parallel examples.	r6455	print("Simple, default map: ", list(result))
MinRK translate last remaining old parallel examples	r3690
Brian E. Granger Reworking parallel examples as notebooks.	r4581	# <codecell>

MinRK translate last remaining old parallel examples	r3690	ar = v.map_async(lambda x: 2*x, range(10))
Thomas Kluyver Update print syntax in parallel examples.	r6455	print("Submitted tasks, got ids: ", ar.msg_ids)
MinRK translate last remaining old parallel examples	r3690	result = ar.get()
Thomas Kluyver Update print syntax in parallel examples.	r6455	print("Using a mapper: ", result)
MinRK translate last remaining old parallel examples	r3690
Brian E. Granger Reworking parallel examples as notebooks.	r4581	# <codecell>

MinRK translate last remaining old parallel examples	r3690	@v.parallel(block=True)
		def f(x): return 2*x

		result = f.map(range(10))
Thomas Kluyver Update print syntax in parallel examples.	r6455	print("Using a parallel function: ", result)
Brian E. Granger Reworking parallel examples as notebooks.	r4581