upstream/mercurial-mirror Files · hgdemandimport/tracing.py

match: optimize matcher when all patterns are of rootfilesin kind...

match: optimize matcher when all patterns are of rootfilesin kind Internally at Google, we use narrowspecs with only rootfilesin-kind patterns. Sometimes there are thousands of such patterns (i.e. thousands of tracked directories). In such cases, it can take quite long to build and evaluate the resulting matcher. This patch optimizes matchers that have only patterns of rootfilesin so it instead of creating a regular expression, it matches the given file's directory against the set of directories. In a repo with ~3600 tracked directories, it takes about 1.35 s to build the matcher and 2.7 s to walk the dirstate before this patch. After, it takes 0.04 s to create the matcher and 0.87 s to walk the dirstate. It may be worthwhile to do similar optimizations for e.g. patterns of type "kind:", but that's not a priority for us right now. Differential Revision: https://phab.mercurial-scm.org/D5058

Augie Fackler - - Load All Authors

File last commit:

r39434:45279028 default


                r40278:19ed212d

default

Download file

             tracing.py
        
                    44 lines
            
             | 1.3 KiB
            
                | text/x-python
            
             |
                PythonLexer
            
             / hgdemandimport / tracing.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      # Support code for event tracing in Mercurial. Lives in demandimport

      # so it can also be used in demandimport.

      #

      # Copyright 2018 Google LLC.

      #

      # This software may be used and distributed according to the terms of the

      # GNU General Public License version 2 or any later version.

      from __future__ import absolute_import

      import contextlib

      import os

      _pipe = None

      _checked = False

      @contextlib.contextmanager

      def log(whencefmt, *whenceargs):

          global _pipe, _session, _checked

          if _pipe is None:

              if _checked:

                  yield

                  return

              _checked = True

              if 'HGCATAPULTSERVERPIPE' not in os.environ:

                  yield

                  return

              _pipe = open(os.environ['HGCATAPULTSERVERPIPE'], 'w', 1)

              _session = os.environ.get('HGCATAPULTSESSION', 'none')

          whence = whencefmt % whenceargs

          try:

              # Both writes to the pipe are wrapped in try/except to ignore

              # errors, as we can see mysterious errors in here if the pager

              # is active. Presumably other conditions could trigger

              # problems too.

              try:

                  _pipe.write('START %s %s\n' % (_session, whence))

              except IOError:

                  pass

              yield

          finally:

              try:

                  _pipe.write('END %s %s\n' % (_session, whence))

              except IOError:

                  pass

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				# Support code for event tracing in Mercurial. Lives in demandimport
				# so it can also be used in demandimport.
				#
				# Copyright 2018 Google LLC.
				#
				# This software may be used and distributed according to the terms of the
				# GNU General Public License version 2 or any later version.
				from __future__ import absolute_import

				import contextlib
				import os

				_pipe = None
				_checked = False

				@contextlib.contextmanager
				def log(whencefmt, *whenceargs):
				global _pipe, _session, _checked
				if _pipe is None:
				if _checked:
				yield
				return
				_checked = True
				if 'HGCATAPULTSERVERPIPE' not in os.environ:
				yield
				return
				_pipe = open(os.environ['HGCATAPULTSERVERPIPE'], 'w', 1)
				_session = os.environ.get('HGCATAPULTSESSION', 'none')
				whence = whencefmt % whenceargs
				try:
				# Both writes to the pipe are wrapped in try/except to ignore
				# errors, as we can see mysterious errors in here if the pager
				# is active. Presumably other conditions could trigger
				# problems too.
				try:
				_pipe.write('START %s %s\n' % (_session, whence))
				except IOError:
				pass
				yield
				finally:
				try:
				_pipe.write('END %s %s\n' % (_session, whence))
				except IOError:
				pass