upstream/mercurial-mirror Files · contrib/automation/automation.py

revlog: add a small cache of unfiltered chunk...

revlog: add a small cache of unfiltered chunk This can provides a massive boost to the reading of multiple revision and the computation of a valid delta chain. This greatly help operation like `hg log --patch`, delta computation (helping pull/unbundle), linkrev adjustment (helping copy tracing). A first round of benchmark for `hg log --patch --limit 1000` shows improvement in the 10-20% range on "small" repository like pypy or mercurial and large improvements (about 33%) for more complex ones like netbeans and mozilla's. These speeds up are consistent with the improvement to `hg pull` (from a server sending poor deltas) I saw benchmarking this last year. Further benchmark will be run during the freeze. I added some configuration in the experimental space to be able to further test the effect of various tuning for now. This feature should fit well in the "usage/resource profile" configuration that we should land next cycle. When it does not provides a benefit the overhead of the cache seem to be around 2%, a small price for the big improvement. In addition I believe we could shave most of this overhead with a more efficent lru implementation.

Augie Fackler - - Load All Authors

File last commit:

r43346:2372284d default


                r52001:0250e450

default

Download file

             automation.py
        
                    74 lines
            
             | 1.7 KiB
            
                | text/x-python
            
             |
                PythonLexer
            
             / contrib / automation / automation.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #!/usr/bin/env python3

      #

      # automation.py - Perform tasks on remote machines

      #

      # Copyright 2019 Gregory Szorc <gregory.szorc@gmail.com>

      #

      # This software may be used and distributed according to the terms of the

      # GNU General Public License version 2 or any later version.

      import os

      import pathlib

      import subprocess

      import sys

      import venv

      HERE = pathlib.Path(os.path.abspath(__file__)).parent

      REQUIREMENTS_TXT = HERE / 'requirements.txt'

      SOURCE_DIR = HERE.parent.parent

      VENV = SOURCE_DIR / 'build' / 'venv-automation'

      def bootstrap():

          venv_created = not VENV.exists()

          VENV.parent.mkdir(exist_ok=True)

          venv.create(VENV, with_pip=True)

          if os.name == 'nt':

              venv_bin = VENV / 'Scripts'

              pip = venv_bin / 'pip.exe'

              python = venv_bin / 'python.exe'

          else:

              venv_bin = VENV / 'bin'

              pip = venv_bin / 'pip'

              python = venv_bin / 'python'

          args = [

              str(pip),

              'install',

              '-r',

              str(REQUIREMENTS_TXT),

              '--disable-pip-version-check',

          ]

          if not venv_created:

              args.append('-q')

          subprocess.run(args, check=True)

          os.environ['HGAUTOMATION_BOOTSTRAPPED'] = '1'

          os.environ['PATH'] = '%s%s%s' % (venv_bin, os.pathsep, os.environ['PATH'])

          subprocess.run([str(python), __file__] + sys.argv[1:], check=True)

      def run():

          import hgautomation.cli as cli

          # Need to strip off main Python executable.

          cli.main()

      if __name__ == '__main__':

          try:

              if 'HGAUTOMATION_BOOTSTRAPPED' not in os.environ:

                  bootstrap()

              else:

                  run()

          except subprocess.CalledProcessError as e:

              sys.exit(e.returncode)

          except KeyboardInterrupt:

              sys.exit(1)

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#!/usr/bin/env python3
				#
				# automation.py - Perform tasks on remote machines
				#
				# Copyright 2019 Gregory Szorc <gregory.szorc@gmail.com>
				#
				# This software may be used and distributed according to the terms of the
				# GNU General Public License version 2 or any later version.

				import os
				import pathlib
				import subprocess
				import sys
				import venv


				HERE = pathlib.Path(os.path.abspath(__file__)).parent
				REQUIREMENTS_TXT = HERE / 'requirements.txt'
				SOURCE_DIR = HERE.parent.parent
				VENV = SOURCE_DIR / 'build' / 'venv-automation'


				def bootstrap():
				venv_created = not VENV.exists()

				VENV.parent.mkdir(exist_ok=True)

				venv.create(VENV, with_pip=True)

				if os.name == 'nt':
				venv_bin = VENV / 'Scripts'
				pip = venv_bin / 'pip.exe'
				python = venv_bin / 'python.exe'
				else:
				venv_bin = VENV / 'bin'
				pip = venv_bin / 'pip'
				python = venv_bin / 'python'

				args = [
				str(pip),
				'install',
				'-r',
				str(REQUIREMENTS_TXT),
				'--disable-pip-version-check',
				]

				if not venv_created:
				args.append('-q')

				subprocess.run(args, check=True)

				os.environ['HGAUTOMATION_BOOTSTRAPPED'] = '1'
				os.environ['PATH'] = '%s%s%s' % (venv_bin, os.pathsep, os.environ['PATH'])

				subprocess.run([str(python), __file__] + sys.argv[1:], check=True)


				def run():
				import hgautomation.cli as cli

				# Need to strip off main Python executable.
				cli.main()


				if __name__ == '__main__':
				try:
				if 'HGAUTOMATION_BOOTSTRAPPED' not in os.environ:
				bootstrap()
				else:
				run()
				except subprocess.CalledProcessError as e:
				sys.exit(e.returncode)
				except KeyboardInterrupt:
				sys.exit(1)