##// END OF EJS Templates
remove dead workflow parallel example
Min RK -
Show More
@@ -1,352 +1,334 b''
1 {
1 {
2 "cells": [
2 "cells": [
3 {
3 {
4 "cell_type": "markdown",
4 "cell_type": "markdown",
5 "metadata": {},
5 "metadata": {},
6 "source": [
6 "source": [
7 "<img src=\"../images/ipython_logo.png\">"
7 "<img src=\"../images/ipython_logo.png\">"
8 ]
8 ]
9 },
9 },
10 {
10 {
11 "cell_type": "markdown",
11 "cell_type": "markdown",
12 "metadata": {},
12 "metadata": {},
13 "source": [
13 "source": [
14 "Back to the main [Index](../Index.ipynb)"
14 "Back to the main [Index](../Index.ipynb)"
15 ]
15 ]
16 },
16 },
17 {
17 {
18 "cell_type": "markdown",
18 "cell_type": "markdown",
19 "metadata": {},
19 "metadata": {},
20 "source": [
20 "source": [
21 "# Parallel Computing"
21 "# Parallel Computing"
22 ]
22 ]
23 },
23 },
24 {
24 {
25 "cell_type": "markdown",
25 "cell_type": "markdown",
26 "metadata": {},
26 "metadata": {},
27 "source": [
27 "source": [
28 "IPython includes an architecture and library for interactive parallel computing. The enables Python functions, along with their arguments, to be run in parallel a multicore CPU, cluster or cloud using a simple Python API."
28 "IPython includes an architecture and library for interactive parallel computing. The enables Python functions, along with their arguments, to be run in parallel a multicore CPU, cluster or cloud using a simple Python API."
29 ]
29 ]
30 },
30 },
31 {
31 {
32 "cell_type": "markdown",
32 "cell_type": "markdown",
33 "metadata": {},
33 "metadata": {},
34 "source": [
34 "source": [
35 "## Tutorials"
35 "## Tutorials"
36 ]
36 ]
37 },
37 },
38 {
38 {
39 "cell_type": "markdown",
39 "cell_type": "markdown",
40 "metadata": {},
40 "metadata": {},
41 "source": [
41 "source": [
42 "* [Data Publication API](Data Publication API.ipynb) "
42 "* [Data Publication API](Data Publication API.ipynb) "
43 ]
43 ]
44 },
44 },
45 {
45 {
46 "cell_type": "markdown",
46 "cell_type": "markdown",
47 "metadata": {},
47 "metadata": {},
48 "source": [
48 "source": [
49 "## Examples"
49 "## Examples"
50 ]
50 ]
51 },
51 },
52 {
52 {
53 "cell_type": "markdown",
53 "cell_type": "markdown",
54 "metadata": {},
54 "metadata": {},
55 "source": [
55 "source": [
56 "* [Monitoring an MPI Simulation - 1](Monitoring an MPI Simulation - 1.ipynb)\n",
56 "* [Monitoring an MPI Simulation - 1](Monitoring an MPI Simulation - 1.ipynb)\n",
57 "* [Monitoring an MPI Simulation - 2](Monitoring an MPI Simulation - 2.ipynb)\n",
57 "* [Monitoring an MPI Simulation - 2](Monitoring an MPI Simulation - 2.ipynb)\n",
58 "* [Parallel Decorator and map](Parallel Decorator and map.ipynb)\n",
58 "* [Parallel Decorator and map](Parallel Decorator and map.ipynb)\n",
59 "* [Parallel Magics](Parallel Magics.ipynb)\n",
59 "* [Parallel Magics](Parallel Magics.ipynb)\n",
60 "* [Using Dill](Using Dill.ipynb)\n",
60 "* [Using Dill](Using Dill.ipynb)\n",
61 "* [Using MPI with IPython Parallel](Using MPI with IPython Parallel.ipynb)\n",
61 "* [Using MPI with IPython Parallel](Using MPI with IPython Parallel.ipynb)\n",
62 "* [Monte Carlo Options](Monte Carlo Options.ipynb)"
62 "* [Monte Carlo Options](Monte Carlo Options.ipynb)"
63 ]
63 ]
64 },
64 },
65 {
65 {
66 "cell_type": "markdown",
66 "cell_type": "markdown",
67 "metadata": {},
67 "metadata": {},
68 "source": [
68 "source": [
69 "## Non-notebook examples"
69 "## Non-notebook examples"
70 ]
70 ]
71 },
71 },
72 {
72 {
73 "cell_type": "markdown",
73 "cell_type": "markdown",
74 "metadata": {},
74 "metadata": {},
75 "source": [
75 "source": [
76 "This directory also contains examples that are regular Python (`.py`) files."
76 "This directory also contains examples that are regular Python (`.py`) files."
77 ]
77 ]
78 },
78 },
79 {
79 {
80 "cell_type": "code",
80 "cell_type": "code",
81 "execution_count": 1,
81 "execution_count": 1,
82 "metadata": {
82 "metadata": {
83 "collapsed": false
83 "collapsed": false
84 },
84 },
85 "outputs": [
85 "outputs": [
86 {
86 {
87 "data": {
87 "data": {
88 "text/html": [
88 "text/html": [
89 "<a href='customresults.py' target='_blank'>customresults.py</a><br>"
89 "<a href='customresults.py' target='_blank'>customresults.py</a><br>"
90 ],
90 ],
91 "text/plain": [
91 "text/plain": [
92 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/customresults.py"
92 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/customresults.py"
93 ]
93 ]
94 },
94 },
95 "metadata": {},
95 "metadata": {},
96 "output_type": "display_data"
96 "output_type": "display_data"
97 },
97 },
98 {
98 {
99 "data": {
99 "data": {
100 "text/html": [
100 "text/html": [
101 "<a href='dagdeps.py' target='_blank'>dagdeps.py</a><br>"
101 "<a href='dagdeps.py' target='_blank'>dagdeps.py</a><br>"
102 ],
102 ],
103 "text/plain": [
103 "text/plain": [
104 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/dagdeps.py"
104 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/dagdeps.py"
105 ]
105 ]
106 },
106 },
107 "metadata": {},
107 "metadata": {},
108 "output_type": "display_data"
108 "output_type": "display_data"
109 },
109 },
110 {
110 {
111 "data": {
111 "data": {
112 "text/html": [
112 "text/html": [
113 "<a href='dependencies.py' target='_blank'>dependencies.py</a><br>"
113 "<a href='dependencies.py' target='_blank'>dependencies.py</a><br>"
114 ],
114 ],
115 "text/plain": [
115 "text/plain": [
116 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/dependencies.py"
116 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/dependencies.py"
117 ]
117 ]
118 },
118 },
119 "metadata": {},
119 "metadata": {},
120 "output_type": "display_data"
120 "output_type": "display_data"
121 },
121 },
122 {
122 {
123 "data": {
123 "data": {
124 "text/html": [
124 "text/html": [
125 "<a href='fetchparse.py' target='_blank'>fetchparse.py</a><br>"
125 "<a href='fetchparse.py' target='_blank'>fetchparse.py</a><br>"
126 ],
126 ],
127 "text/plain": [
127 "text/plain": [
128 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/fetchparse.py"
128 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/fetchparse.py"
129 ]
129 ]
130 },
130 },
131 "metadata": {},
131 "metadata": {},
132 "output_type": "display_data"
132 "output_type": "display_data"
133 },
133 },
134 {
134 {
135 "data": {
135 "data": {
136 "text/html": [
136 "text/html": [
137 "<a href='iopubwatcher.py' target='_blank'>iopubwatcher.py</a><br>"
137 "<a href='iopubwatcher.py' target='_blank'>iopubwatcher.py</a><br>"
138 ],
138 ],
139 "text/plain": [
139 "text/plain": [
140 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/iopubwatcher.py"
140 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/iopubwatcher.py"
141 ]
141 ]
142 },
142 },
143 "metadata": {},
143 "metadata": {},
144 "output_type": "display_data"
144 "output_type": "display_data"
145 },
145 },
146 {
146 {
147 "data": {
147 "data": {
148 "text/html": [
148 "text/html": [
149 "<a href='itermapresult.py' target='_blank'>itermapresult.py</a><br>"
149 "<a href='itermapresult.py' target='_blank'>itermapresult.py</a><br>"
150 ],
150 ],
151 "text/plain": [
151 "text/plain": [
152 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/itermapresult.py"
152 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/itermapresult.py"
153 ]
153 ]
154 },
154 },
155 "metadata": {},
155 "metadata": {},
156 "output_type": "display_data"
156 "output_type": "display_data"
157 },
157 },
158 {
158 {
159 "data": {
159 "data": {
160 "text/html": [
160 "text/html": [
161 "<a href='nwmerge.py' target='_blank'>nwmerge.py</a><br>"
161 "<a href='nwmerge.py' target='_blank'>nwmerge.py</a><br>"
162 ],
162 ],
163 "text/plain": [
163 "text/plain": [
164 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/nwmerge.py"
164 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/nwmerge.py"
165 ]
165 ]
166 },
166 },
167 "metadata": {},
167 "metadata": {},
168 "output_type": "display_data"
168 "output_type": "display_data"
169 },
169 },
170 {
170 {
171 "data": {
171 "data": {
172 "text/html": [
172 "text/html": [
173 "<a href='phistogram.py' target='_blank'>phistogram.py</a><br>"
173 "<a href='phistogram.py' target='_blank'>phistogram.py</a><br>"
174 ],
174 ],
175 "text/plain": [
175 "text/plain": [
176 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/phistogram.py"
176 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/phistogram.py"
177 ]
177 ]
178 },
178 },
179 "metadata": {},
179 "metadata": {},
180 "output_type": "display_data"
180 "output_type": "display_data"
181 },
181 },
182 {
182 {
183 "data": {
183 "data": {
184 "text/html": [
184 "text/html": [
185 "<a href='task_profiler.py' target='_blank'>task_profiler.py</a><br>"
185 "<a href='task_profiler.py' target='_blank'>task_profiler.py</a><br>"
186 ],
186 ],
187 "text/plain": [
187 "text/plain": [
188 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/task_profiler.py"
188 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/task_profiler.py"
189 ]
189 ]
190 },
190 },
191 "metadata": {},
191 "metadata": {},
192 "output_type": "display_data"
192 "output_type": "display_data"
193 },
193 },
194 {
194 {
195 "data": {
195 "data": {
196 "text/html": [
196 "text/html": [
197 "<a href='throughput.py' target='_blank'>throughput.py</a><br>"
197 "<a href='throughput.py' target='_blank'>throughput.py</a><br>"
198 ],
198 ],
199 "text/plain": [
199 "text/plain": [
200 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/throughput.py"
200 "/Users/bgranger/Documents/Computing/IPython/code/ipython/examples/Parallel Computing/throughput.py"
201 ]
201 ]
202 },
202 },
203 "metadata": {},
203 "metadata": {},
204 "output_type": "display_data"
204 "output_type": "display_data"
205 }
205 }
206 ],
206 ],
207 "source": [
207 "source": [
208 "%run ../utils/list_pyfiles.ipy"
208 "%run ../utils/list_pyfiles.ipy"
209 ]
209 ]
210 },
210 },
211 {
211 {
212 "cell_type": "markdown",
212 "cell_type": "markdown",
213 "metadata": {},
213 "metadata": {},
214 "source": [
214 "source": [
215 "More substantial examples can be found in subdirectories:"
215 "More substantial examples can be found in subdirectories:"
216 ]
216 ]
217 },
217 },
218 {
218 {
219 "cell_type": "code",
219 "cell_type": "code",
220 "execution_count": 2,
220 "execution_count": 2,
221 "metadata": {
221 "metadata": {
222 "collapsed": false
222 "collapsed": false
223 },
223 },
224 "outputs": [
224 "outputs": [
225 {
225 {
226 "data": {
226 "data": {
227 "text/html": [
227 "text/html": [
228 "daVinci Word Count/<br>\n",
228 "daVinci Word Count/<br>\n",
229 "&nbsp;&nbsp;<a href='daVinci Word Count/pwordfreq.py' target='_blank'>pwordfreq.py</a><br>\n",
229 "&nbsp;&nbsp;<a href='daVinci Word Count/pwordfreq.py' target='_blank'>pwordfreq.py</a><br>\n",
230 "&nbsp;&nbsp;<a href='daVinci Word Count/wordfreq.py' target='_blank'>wordfreq.py</a><br>"
230 "&nbsp;&nbsp;<a href='daVinci Word Count/wordfreq.py' target='_blank'>wordfreq.py</a><br>"
231 ],
231 ],
232 "text/plain": [
232 "text/plain": [
233 "daVinci Word Count/\n",
233 "daVinci Word Count/\n",
234 " pwordfreq.py\n",
234 " pwordfreq.py\n",
235 " wordfreq.py"
235 " wordfreq.py"
236 ]
236 ]
237 },
237 },
238 "metadata": {},
238 "metadata": {},
239 "output_type": "display_data"
239 "output_type": "display_data"
240 },
240 },
241 {
241 {
242 "data": {
242 "data": {
243 "text/html": [
243 "text/html": [
244 "interengine/<br>\n",
244 "interengine/<br>\n",
245 "&nbsp;&nbsp;<a href='interengine/bintree.py' target='_blank'>bintree.py</a><br>\n",
245 "&nbsp;&nbsp;<a href='interengine/bintree.py' target='_blank'>bintree.py</a><br>\n",
246 "&nbsp;&nbsp;<a href='interengine/bintree_script.py' target='_blank'>bintree_script.py</a><br>\n",
246 "&nbsp;&nbsp;<a href='interengine/bintree_script.py' target='_blank'>bintree_script.py</a><br>\n",
247 "&nbsp;&nbsp;<a href='interengine/communicator.py' target='_blank'>communicator.py</a><br>\n",
247 "&nbsp;&nbsp;<a href='interengine/communicator.py' target='_blank'>communicator.py</a><br>\n",
248 "&nbsp;&nbsp;<a href='interengine/interengine.py' target='_blank'>interengine.py</a><br>"
248 "&nbsp;&nbsp;<a href='interengine/interengine.py' target='_blank'>interengine.py</a><br>"
249 ],
249 ],
250 "text/plain": [
250 "text/plain": [
251 "interengine/\n",
251 "interengine/\n",
252 " bintree.py\n",
252 " bintree.py\n",
253 " bintree_script.py\n",
253 " bintree_script.py\n",
254 " communicator.py\n",
254 " communicator.py\n",
255 " interengine.py"
255 " interengine.py"
256 ]
256 ]
257 },
257 },
258 "metadata": {},
258 "metadata": {},
259 "output_type": "display_data"
259 "output_type": "display_data"
260 },
260 },
261 {
261 {
262 "data": {
262 "data": {
263 "text/html": [],
263 "text/html": [],
264 "text/plain": []
264 "text/plain": []
265 },
265 },
266 "metadata": {},
266 "metadata": {},
267 "output_type": "display_data"
267 "output_type": "display_data"
268 },
268 },
269 {
269 {
270 "data": {
270 "data": {
271 "text/html": [
271 "text/html": [
272 "pi/<br>\n",
272 "pi/<br>\n",
273 "&nbsp;&nbsp;<a href='pi/parallelpi.py' target='_blank'>parallelpi.py</a><br>\n",
273 "&nbsp;&nbsp;<a href='pi/parallelpi.py' target='_blank'>parallelpi.py</a><br>\n",
274 "&nbsp;&nbsp;<a href='pi/pidigits.py' target='_blank'>pidigits.py</a><br>"
274 "&nbsp;&nbsp;<a href='pi/pidigits.py' target='_blank'>pidigits.py</a><br>"
275 ],
275 ],
276 "text/plain": [
276 "text/plain": [
277 "pi/\n",
277 "pi/\n",
278 " parallelpi.py\n",
278 " parallelpi.py\n",
279 " pidigits.py"
279 " pidigits.py"
280 ]
280 ]
281 },
281 },
282 "metadata": {},
282 "metadata": {},
283 "output_type": "display_data"
283 "output_type": "display_data"
284 },
284 },
285 {
285 {
286 "data": {
286 "data": {
287 "text/html": [
287 "text/html": [
288 "rmt/<br>\n",
288 "rmt/<br>\n",
289 "&nbsp;&nbsp;<a href='rmt/rmt.ipy' target='_blank'>rmt.ipy</a><br>\n",
289 "&nbsp;&nbsp;<a href='rmt/rmt.ipy' target='_blank'>rmt.ipy</a><br>\n",
290 "&nbsp;&nbsp;<a href='rmt/rmt.ipynb' target='_blank'>rmt.ipynb</a><br>\n",
290 "&nbsp;&nbsp;<a href='rmt/rmt.ipynb' target='_blank'>rmt.ipynb</a><br>\n",
291 "&nbsp;&nbsp;<a href='rmt/rmtkernel.py' target='_blank'>rmtkernel.py</a><br>"
291 "&nbsp;&nbsp;<a href='rmt/rmtkernel.py' target='_blank'>rmtkernel.py</a><br>"
292 ],
292 ],
293 "text/plain": [
293 "text/plain": [
294 "rmt/\n",
294 "rmt/\n",
295 " rmt.ipy\n",
295 " rmt.ipy\n",
296 " rmt.ipynb\n",
296 " rmt.ipynb\n",
297 " rmtkernel.py"
297 " rmtkernel.py"
298 ]
298 ]
299 },
299 },
300 "metadata": {},
300 "metadata": {},
301 "output_type": "display_data"
301 "output_type": "display_data"
302 },
302 },
303 {
303 {
304 "data": {
304 "data": {
305 "text/html": [
305 "text/html": [
306 "wave2D/<br>\n",
306 "wave2D/<br>\n",
307 "&nbsp;&nbsp;<a href='wave2D/communicator.py' target='_blank'>communicator.py</a><br>\n",
307 "&nbsp;&nbsp;<a href='wave2D/communicator.py' target='_blank'>communicator.py</a><br>\n",
308 "&nbsp;&nbsp;<a href='wave2D/parallelwave-mpi.py' target='_blank'>parallelwave-mpi.py</a><br>\n",
308 "&nbsp;&nbsp;<a href='wave2D/parallelwave-mpi.py' target='_blank'>parallelwave-mpi.py</a><br>\n",
309 "&nbsp;&nbsp;<a href='wave2D/parallelwave.py' target='_blank'>parallelwave.py</a><br>\n",
309 "&nbsp;&nbsp;<a href='wave2D/parallelwave.py' target='_blank'>parallelwave.py</a><br>\n",
310 "&nbsp;&nbsp;<a href='wave2D/RectPartitioner.py' target='_blank'>RectPartitioner.py</a><br>\n",
310 "&nbsp;&nbsp;<a href='wave2D/RectPartitioner.py' target='_blank'>RectPartitioner.py</a><br>\n",
311 "&nbsp;&nbsp;<a href='wave2D/wavesolver.py' target='_blank'>wavesolver.py</a><br>"
311 "&nbsp;&nbsp;<a href='wave2D/wavesolver.py' target='_blank'>wavesolver.py</a><br>"
312 ],
312 ],
313 "text/plain": [
313 "text/plain": [
314 "wave2D/\n",
314 "wave2D/\n",
315 " communicator.py\n",
315 " communicator.py\n",
316 " parallelwave-mpi.py\n",
316 " parallelwave-mpi.py\n",
317 " parallelwave.py\n",
317 " parallelwave.py\n",
318 " RectPartitioner.py\n",
318 " RectPartitioner.py\n",
319 " wavesolver.py"
319 " wavesolver.py"
320 ]
320 ]
321 },
321 },
322 "metadata": {},
322 "metadata": {},
323 "output_type": "display_data"
323 "output_type": "display_data"
324 },
325 {
326 "data": {
327 "text/html": [
328 "workflow/<br>\n",
329 "&nbsp;&nbsp;<a href='workflow/client.py' target='_blank'>client.py</a><br>\n",
330 "&nbsp;&nbsp;<a href='workflow/job_wrapper.py' target='_blank'>job_wrapper.py</a><br>\n",
331 "&nbsp;&nbsp;<a href='workflow/wmanager.py' target='_blank'>wmanager.py</a><br>"
332 ],
333 "text/plain": [
334 "workflow/\n",
335 " client.py\n",
336 " job_wrapper.py\n",
337 " wmanager.py"
338 ]
339 },
340 "metadata": {},
341 "output_type": "display_data"
342 }
324 }
343 ],
325 ],
344 "source": [
326 "source": [
345 "%run ../utils/list_subdirs.ipy"
327 "%run ../utils/list_subdirs.ipy"
346 ]
328 ]
347 }
329 }
348 ],
330 ],
349 "metadata": {},
331 "metadata": {},
350 "nbformat": 4,
332 "nbformat": 4,
351 "nbformat_minor": 0
333 "nbformat_minor": 0
352 } No newline at end of file
334 }
1 NO CONTENT: file was removed
NO CONTENT: file was removed
1 NO CONTENT: file was removed
NO CONTENT: file was removed
1 NO CONTENT: file was removed
NO CONTENT: file was removed
1 NO CONTENT: file was removed
NO CONTENT: file was removed
General Comments 0
You need to be logged in to leave comments. Login now