upstream/mercurial-mirror Files · contrib/fuzz/revlog_corpus.py

revlog: add a small cache of unfiltered chunk...

revlog: add a small cache of unfiltered chunk This can provides a massive boost to the reading of multiple revision and the computation of a valid delta chain. This greatly help operation like `hg log --patch`, delta computation (helping pull/unbundle), linkrev adjustment (helping copy tracing). A first round of benchmark for `hg log --patch --limit 1000` shows improvement in the 10-20% range on "small" repository like pypy or mercurial and large improvements (about 33%) for more complex ones like netbeans and mozilla's. These speeds up are consistent with the improvement to `hg pull` (from a server sending poor deltas) I saw benchmarking this last year. Further benchmark will be run during the freeze. I added some configuration in the experimental space to be able to further test the effect of various tuning for now. This feature should fit well in the "usage/resource profile" configuration that we should land next cycle. When it does not provides a benefit the overhead of the cache seem to be around 2%, a small price for the big improvement. In addition I believe we could shave most of this overhead with a more efficent lru implementation.

Gregory Szorc - - Load All Authors

File last commit:

r49730:6000f5b2 default


                r52001:0250e450

default

Download file

             revlog_corpus.py
        
                    23 lines
            
             | 812 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / contrib / fuzz / revlog_corpus.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      import argparse

      import os

      import zipfile

      ap = argparse.ArgumentParser()

      ap.add_argument("out", metavar="some.zip", type=str, nargs=1)

      args = ap.parse_args()

      reporoot = os.path.normpath(os.path.join(os.path.dirname(__file__), '..', '..'))

      # typically a standalone index

      changelog = os.path.join(reporoot, '.hg', 'store', '00changelog.i')

      # an inline revlog with only a few revisions

      contributing = os.path.join(

          reporoot, '.hg', 'store', 'data', 'contrib', 'fuzz', 'mpatch.cc.i'

      )

      with zipfile.ZipFile(args.out[0], "w", zipfile.ZIP_STORED) as zf:

          if os.path.exists(changelog):

              with open(changelog, 'rb') as f:

                  zf.writestr("00changelog.i", f.read())

          if os.path.exists(contributing):

              with open(contributing, 'rb') as f:

                  zf.writestr("contributing.i", f.read())

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				import argparse
				import os
				import zipfile

				ap = argparse.ArgumentParser()
				ap.add_argument("out", metavar="some.zip", type=str, nargs=1)
				args = ap.parse_args()

				reporoot = os.path.normpath(os.path.join(os.path.dirname(__file__), '..', '..'))
				# typically a standalone index
				changelog = os.path.join(reporoot, '.hg', 'store', '00changelog.i')
				# an inline revlog with only a few revisions
				contributing = os.path.join(
				reporoot, '.hg', 'store', 'data', 'contrib', 'fuzz', 'mpatch.cc.i'
				)

				with zipfile.ZipFile(args.out[0], "w", zipfile.ZIP_STORED) as zf:
				if os.path.exists(changelog):
				with open(changelog, 'rb') as f:
				zf.writestr("00changelog.i", f.read())
				if os.path.exists(contributing):
				with open(contributing, 'rb') as f:
				zf.writestr("contributing.i", f.read())