upstream/ipython Files · IPython/parallel/tests/test_mongodb.py

regexp group in BatchLauncher, no Condor -verbose...

regexp group in BatchLauncher, no Condor -verbose Previously I used condor_submit -verbose so that I could pull the job id from the first line. However, when submitting many jobs it's silly to have to search through some many lines of output. Now we have a regexp for Condor that matches on the non-verbose output. Here the job_id is on the end of the output, so using grouping in our job_id_regexp becomes very useful. To account for this I have added a job_id_regexp_group property to the BatchLauncher and it's subclasses. The default of 0 means the whole regexp is matched - however now an integer can be passed in here to instead select a subgroup of the expression (see CondorLauncher and the mechanism will be clear).

Michał Górny - - Load All Authors

File last commit:

r9539:b0f830ff


                r10991:ee0bd57f

Download file

             test_mongodb.py
        
                    52 lines
            
             | 1.3 KiB
            
                | text/x-python
            
             |
                PythonLexer
            
             / IPython / parallel / tests / test_mongodb.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      """Tests for mongodb backend

      Authors:

      * Min RK

      """

      #-------------------------------------------------------------------------------

      #  Copyright (C) 2011  The IPython Development Team

      #

      #  Distributed under the terms of the BSD License.  The full license is in

      #  the file COPYING, distributed as part of this software.

      #-------------------------------------------------------------------------------

      #-------------------------------------------------------------------------------

      # Imports

      #-------------------------------------------------------------------------------

      import os

      from unittest import TestCase

      from nose import SkipTest

      from pymongo import Connection

      from IPython.parallel.controller.mongodb import MongoDB

      from . import test_db

      conn_kwargs = {}

      if 'DB_IP' in os.environ:

          conn_kwargs['host'] = os.environ['DB_IP']

      if 'DB_PORT' in os.environ:

          conn_kwargs['port'] = int(os.environ['DB_PORT'])

      try:

          c = Connection(**conn_kwargs)

      except Exception:

          c=None

      class TestMongoBackend(test_db.TaskDBTest, TestCase):

          """MongoDB backend tests"""

          def create_db(self):

              try:

                  return MongoDB(database='iptestdb', _connection=c)

              except Exception:

                  raise SkipTest("Couldn't connect to mongodb")

      def teardown(self):

          if c is not None:

              c.drop_database('iptestdb')

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				"""Tests for mongodb backend

				Authors:

				* Min RK
				"""

				#-------------------------------------------------------------------------------
				# Copyright (C) 2011 The IPython Development Team
				#
				# Distributed under the terms of the BSD License. The full license is in
				# the file COPYING, distributed as part of this software.
				#-------------------------------------------------------------------------------

				#-------------------------------------------------------------------------------
				# Imports
				#-------------------------------------------------------------------------------

				import os

				from unittest import TestCase

				from nose import SkipTest

				from pymongo import Connection
				from IPython.parallel.controller.mongodb import MongoDB

				from . import test_db

				conn_kwargs = {}
				if 'DB_IP' in os.environ:
				conn_kwargs['host'] = os.environ['DB_IP']
				if 'DB_PORT' in os.environ:
				conn_kwargs['port'] = int(os.environ['DB_PORT'])

				try:
				c = Connection(**conn_kwargs)
				except Exception:
				c=None

				class TestMongoBackend(test_db.TaskDBTest, TestCase):
				"""MongoDB backend tests"""

				def create_db(self):
				try:
				return MongoDB(database='iptestdb', _connection=c)
				except Exception:
				raise SkipTest("Couldn't connect to mongodb")

				def teardown(self):
				if c is not None:
				c.drop_database('iptestdb')