upstream/mercurial-mirror Files · tests/test-contrib-perf.t

perf: add command for measuring revlog chunk operations...

perf: add command for measuring revlog chunk operations Upcoming commits will teach revlogs to leverage the new compression engine API so that new compression formats can more easily be leveraged in revlogs. We want to be sure this refactoring doesn't regress performance. So this commit introduces "perfrevchunks" to explicitly test performance of reading, decompressing, and recompressing revlog chunks. Here is output when run on the mozilla-unified repo: $ hg perfrevlogchunks -c ! read ! wall 0.346603 comb 0.350000 user 0.340000 sys 0.010000 (best of 28) ! read w/ reused fd ! wall 0.337707 comb 0.340000 user 0.320000 sys 0.020000 (best of 30) ! read batch ! wall 0.013206 comb 0.020000 user 0.000000 sys 0.020000 (best of 221) ! read batch w/ reused fd ! wall 0.013259 comb 0.030000 user 0.010000 sys 0.020000 (best of 222) ! chunk ! wall 1.909939 comb 1.910000 user 1.900000 sys 0.010000 (best of 6) ! chunk batch ! wall 1.750677 comb 1.760000 user 1.740000 sys 0.020000 (best of 6) ! compress ! wall 5.668004 comb 5.670000 user 5.670000 sys 0.000000 (best of 3) $ hg perfrevlogchunks -m ! read ! wall 0.365834 comb 0.370000 user 0.350000 sys 0.020000 (best of 26) ! read w/ reused fd ! wall 0.350160 comb 0.350000 user 0.320000 sys 0.030000 (best of 28) ! read batch ! wall 0.024777 comb 0.020000 user 0.000000 sys 0.020000 (best of 119) ! read batch w/ reused fd ! wall 0.024895 comb 0.030000 user 0.000000 sys 0.030000 (best of 118) ! chunk ! wall 2.514061 comb 2.520000 user 2.480000 sys 0.040000 (best of 4) ! chunk batch ! wall 2.380788 comb 2.380000 user 2.360000 sys 0.020000 (best of 5) ! compress ! wall 9.815297 comb 9.820000 user 9.820000 sys 0.000000 (best of 3) We already see some interesting data, such as how much slower non-batched chunk reading is and that zlib compression appears to be >2x slower than decompression. I didn't have the data when I wrote this commit message, but I ran this on Mozilla's NFS-based Mercurial server and the time for reading with a reused file descriptor was faster. So I think it is worth testing both with and without file descriptor reuse so we can make informed decisions about recycling file descriptors.

Gregory Szorc - - Load All Authors

File last commit:

r30451:94ca0e13 default


                r30451:94ca0e13

default

Download file

             test-contrib-perf.t
        
                    166 lines
            
             | 4.6 KiB
            
                | text/troff
            
             |
                Tads3Lexer
            
             / tests / test-contrib-perf.t
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
      #require test-repo

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
      Set vars:

        timeless
    
tests: silence test-repo obsolete warning...

              r29219
            
        $ . "$TESTDIR/helpers-testrepo.sh"

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        $ CONTRIBDIR="$TESTDIR/../contrib"

        timeless
    
tests: use a single repo for test-contrib-perf

              r27309
            
      Prepare repo:

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        timeless
    
tests: use a single repo for test-contrib-perf

              r27309
            
        $ hg init

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        $ echo this is file a > a

        $ hg add a

        $ hg commit -m first

        $ echo adding to file a >> a

        $ hg commit -m second

        $ echo adding more to file a >> a

        $ hg commit -m third

        $ hg up -r 0

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ echo merge-this >> a

        $ hg commit -m merge-able

        created new head

        $ hg up -r 2

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

      perfstatus

        timeless
    
tests: use a single repo for test-contrib-perf

              r27309
            
        $ cat >> $HGRCPATH << EOF

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        > [extensions]

        > perfstatusext=$CONTRIBDIR/perf.py

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
        > [perf]

        > presleep=0

        > stub=on

        > parentscount=1

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        > EOF

        $ hg help perfstatusext

        perfstatusext extension - helper extension to measure performance

        list of commands:

         perfaddremove

                       (no help text available)

         perfancestors

                       (no help text available)

         perfancestorset

                       (no help text available)

         perfannotate  (no help text available)

        Gregory Szorc
    
perf: support bdiffing multiple revisions in a single revlog...

              r30336
            
         perfbdiff     benchmark a bdiff between revisions

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
         perfbranchmap

                       benchmark the update of a branchmap

         perfcca       (no help text available)

        Gregory Szorc
    
perf: add perfchangegroupchangelog command...

              r30018
            
         perfchangegroupchangelog

                       Benchmark producing a changelog group for a changegroup.

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
         perfchangeset

                       (no help text available)

         perfctxfiles  (no help text available)

         perfdiffwd    Profile diff of working directory changes

         perfdirfoldmap

                       (no help text available)

         perfdirs      (no help text available)

         perfdirstate  (no help text available)

         perfdirstatedirs

                       (no help text available)

         perfdirstatefoldmap

                       (no help text available)

         perfdirstatewrite

                       (no help text available)

         perffncacheencode

                       (no help text available)

         perffncacheload

                       (no help text available)

         perffncachewrite

                       (no help text available)

         perfheads     (no help text available)

         perfindex     (no help text available)

         perfloadmarkers

                       benchmark the time to parse the on-disk markers for a repo

         perflog       (no help text available)

         perflookup    (no help text available)

        Gregory Szorc
    
perf: add perflrucachedict command...

              r27286
            
         perflrucachedict

                       (no help text available)

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
         perfmanifest  (no help text available)

         perfmergecalculate

                       (no help text available)

         perfmoonwalk  benchmark walking the changelog backwards

         perfnodelookup

                       (no help text available)

         perfparents   (no help text available)

         perfpathcopies

                       (no help text available)

         perfrawfiles  (no help text available)

        Gregory Szorc
    
perf: use standard arguments for perfrevlog...

              r27492
            
         perfrevlog    Benchmark reading a series of revisions from a revlog.

        Gregory Szorc
    
perf: add command for measuring revlog chunk operations...

              r30451
            
         perfrevlogchunks

                       Benchmark operations on revlog chunks.

        Gregory Szorc
    
perf: add perfrevlogrevision...

              r27470
            
         perfrevlogrevision

                       Benchmark obtaining a revlog revision.

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
         perfrevrange  (no help text available)

         perfrevset    benchmark the execution time of a revset

         perfstartup   (no help text available)

         perfstatus    (no help text available)

         perftags      (no help text available)

         perftemplating

                       (no help text available)

         perfvolatilesets

                       benchmark the computation of various volatile set

         perfwalk      (no help text available)

        timeless
    
help: use single quotes in use warning

              r29974
            
        (use 'hg help -v perfstatusext' to show built-in aliases and global options)

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
        $ hg perfaddremove

        $ hg perfancestors

        $ hg perfancestorset 2

        $ hg perfannotate a

        Gregory Szorc
    
perf: add perfbdiff...

              r30307
            
        $ hg perfbdiff -c 1

        Gregory Szorc
    
perf: unbust perfbdiff --alldata...

              r30426
            
        $ hg perfbdiff --alldata 1

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
        $ hg perfbranchmap

        $ hg perfcca

        Gregory Szorc
    
perf: add perfchangegroupchangelog command...

              r30018
            
        $ hg perfchangegroupchangelog

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
        $ hg perfchangeset 2

        $ hg perfctxfiles 2

        $ hg perfdiffwd

        $ hg perfdirfoldmap

        $ hg perfdirs

        $ hg perfdirstate

        $ hg perfdirstatedirs

        $ hg perfdirstatefoldmap

        $ hg perfdirstatewrite

        $ hg perffncacheencode

        $ hg perffncacheload

        $ hg perffncachewrite

        $ hg perfheads

        $ hg perfindex

        $ hg perfloadmarkers

        $ hg perflog

        $ hg perflookup 2

        $ hg perflrucache

        $ hg perfmanifest 2

        $ hg perfmergecalculate -r 3

        $ hg perfmoonwalk

        $ hg perfnodelookup 2

        $ hg perfpathcopies 1 2

        $ hg perfrawfiles 2

        $ hg perfrevlog .hg/store/data/a.i

        Gregory Szorc
    
perf: add perfrevlogrevision...

              r27470
            
        $ hg perfrevlogrevision -m 0

        Gregory Szorc
    
perf: add command for measuring revlog chunk operations...

              r30451
            
        $ hg perfrevlogchunks -c

        timeless
    
tests: drop require slow in test-contrib-perf...

              r27315
            
        $ hg perfrevrange

        $ hg perfrevset 'all()'

        $ hg perfstartup

        $ hg perfstatus

        $ hg perftags

        $ hg perftemplating

        $ hg perfvolatilesets

        $ hg perfwalk

        $ hg perfparents

        timeless
    
test-contrib-perf: add smoke tests for perf.py

              r27101
            
        FUJIWARA Katsunori
    
tests: introduce check-perf-code.py to add extra checks on perf.py...

              r29570
            
      Check perf.py for historical portability

        $ cd "$TESTDIR/.."

        FUJIWARA Katsunori
    
tests: check importing modules in perf.py for historical portability...

              r29571
            
        $ (hg files -r 1.2 glob:mercurial/*.c glob:mercurial/*.py;

        >  hg files -r tip glob:mercurial/*.c glob:mercurial/*.py) |

        > "$TESTDIR"/check-perf-code.py contrib/perf.py

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

timeless tests: drop require slow in test-contrib-perf...	r27315	#require test-repo
timeless test-contrib-perf: add smoke tests for perf.py	r27101
		Set vars:

timeless tests: silence test-repo obsolete warning...	r29219	$ . "$TESTDIR/helpers-testrepo.sh"
timeless test-contrib-perf: add smoke tests for perf.py	r27101	$ CONTRIBDIR="$TESTDIR/../contrib"

timeless tests: use a single repo for test-contrib-perf	r27309	Prepare repo:
timeless test-contrib-perf: add smoke tests for perf.py	r27101
timeless tests: use a single repo for test-contrib-perf	r27309	$ hg init
timeless test-contrib-perf: add smoke tests for perf.py	r27101
		$ echo this is file a > a
		$ hg add a
		$ hg commit -m first

		$ echo adding to file a >> a
		$ hg commit -m second

		$ echo adding more to file a >> a
		$ hg commit -m third

		$ hg up -r 0
		1 files updated, 0 files merged, 0 files removed, 0 files unresolved
		$ echo merge-this >> a
		$ hg commit -m merge-able
		created new head

		$ hg up -r 2
		1 files updated, 0 files merged, 0 files removed, 0 files unresolved

		perfstatus

timeless tests: use a single repo for test-contrib-perf	r27309	$ cat >> $HGRCPATH << EOF
timeless test-contrib-perf: add smoke tests for perf.py	r27101	> [extensions]
		> perfstatusext=$CONTRIBDIR/perf.py
timeless tests: drop require slow in test-contrib-perf...	r27315	> [perf]
		> presleep=0
		> stub=on
		> parentscount=1
timeless test-contrib-perf: add smoke tests for perf.py	r27101	> EOF
		$ hg help perfstatusext
		perfstatusext extension - helper extension to measure performance

		list of commands:

		perfaddremove
		(no help text available)
		perfancestors
		(no help text available)
		perfancestorset
		(no help text available)
		perfannotate (no help text available)
Gregory Szorc perf: support bdiffing multiple revisions in a single revlog...	r30336	perfbdiff benchmark a bdiff between revisions
timeless test-contrib-perf: add smoke tests for perf.py	r27101	perfbranchmap
		benchmark the update of a branchmap
		perfcca (no help text available)
Gregory Szorc perf: add perfchangegroupchangelog command...	r30018	perfchangegroupchangelog
		Benchmark producing a changelog group for a changegroup.
timeless test-contrib-perf: add smoke tests for perf.py	r27101	perfchangeset
		(no help text available)
		perfctxfiles (no help text available)
		perfdiffwd Profile diff of working directory changes
		perfdirfoldmap
		(no help text available)
		perfdirs (no help text available)
		perfdirstate (no help text available)
		perfdirstatedirs
		(no help text available)
		perfdirstatefoldmap
		(no help text available)
		perfdirstatewrite
		(no help text available)
		perffncacheencode
		(no help text available)
		perffncacheload
		(no help text available)
		perffncachewrite
		(no help text available)
		perfheads (no help text available)
		perfindex (no help text available)
		perfloadmarkers
		benchmark the time to parse the on-disk markers for a repo
		perflog (no help text available)
		perflookup (no help text available)
Gregory Szorc perf: add perflrucachedict command...	r27286	perflrucachedict
		(no help text available)
timeless test-contrib-perf: add smoke tests for perf.py	r27101	perfmanifest (no help text available)
		perfmergecalculate
		(no help text available)
		perfmoonwalk benchmark walking the changelog backwards
		perfnodelookup
		(no help text available)
		perfparents (no help text available)
		perfpathcopies
		(no help text available)
		perfrawfiles (no help text available)
Gregory Szorc perf: use standard arguments for perfrevlog...	r27492	perfrevlog Benchmark reading a series of revisions from a revlog.
Gregory Szorc perf: add command for measuring revlog chunk operations...	r30451	perfrevlogchunks
		Benchmark operations on revlog chunks.
Gregory Szorc perf: add perfrevlogrevision...	r27470	perfrevlogrevision
		Benchmark obtaining a revlog revision.
timeless test-contrib-perf: add smoke tests for perf.py	r27101	perfrevrange (no help text available)
		perfrevset benchmark the execution time of a revset
		perfstartup (no help text available)
		perfstatus (no help text available)
		perftags (no help text available)
		perftemplating
		(no help text available)
		perfvolatilesets
		benchmark the computation of various volatile set
		perfwalk (no help text available)

timeless help: use single quotes in use warning	r29974	(use 'hg help -v perfstatusext' to show built-in aliases and global options)
timeless tests: drop require slow in test-contrib-perf...	r27315	$ hg perfaddremove
		$ hg perfancestors
		$ hg perfancestorset 2
		$ hg perfannotate a
Gregory Szorc perf: add perfbdiff...	r30307	$ hg perfbdiff -c 1
Gregory Szorc perf: unbust perfbdiff --alldata...	r30426	$ hg perfbdiff --alldata 1
timeless tests: drop require slow in test-contrib-perf...	r27315	$ hg perfbranchmap
		$ hg perfcca
Gregory Szorc perf: add perfchangegroupchangelog command...	r30018	$ hg perfchangegroupchangelog
timeless tests: drop require slow in test-contrib-perf...	r27315	$ hg perfchangeset 2
		$ hg perfctxfiles 2
		$ hg perfdiffwd
		$ hg perfdirfoldmap
		$ hg perfdirs
		$ hg perfdirstate
		$ hg perfdirstatedirs
		$ hg perfdirstatefoldmap
		$ hg perfdirstatewrite
		$ hg perffncacheencode
		$ hg perffncacheload
		$ hg perffncachewrite
		$ hg perfheads
		$ hg perfindex
		$ hg perfloadmarkers
		$ hg perflog
		$ hg perflookup 2
		$ hg perflrucache
		$ hg perfmanifest 2
		$ hg perfmergecalculate -r 3
		$ hg perfmoonwalk
		$ hg perfnodelookup 2
		$ hg perfpathcopies 1 2
		$ hg perfrawfiles 2
		$ hg perfrevlog .hg/store/data/a.i
Gregory Szorc perf: add perfrevlogrevision...	r27470	$ hg perfrevlogrevision -m 0
Gregory Szorc perf: add command for measuring revlog chunk operations...	r30451	$ hg perfrevlogchunks -c
timeless tests: drop require slow in test-contrib-perf...	r27315	$ hg perfrevrange
		$ hg perfrevset 'all()'
		$ hg perfstartup
		$ hg perfstatus
		$ hg perftags
		$ hg perftemplating
		$ hg perfvolatilesets
		$ hg perfwalk
		$ hg perfparents
timeless test-contrib-perf: add smoke tests for perf.py	r27101
FUJIWARA Katsunori tests: introduce check-perf-code.py to add extra checks on perf.py...	r29570	Check perf.py for historical portability

		$ cd "$TESTDIR/.."

FUJIWARA Katsunori tests: check importing modules in perf.py for historical portability...	r29571	$ (hg files -r 1.2 glob:mercurial/.c glob:mercurial/.py;
		> hg files -r tip glob:mercurial/.c glob:mercurial/.py) \|
		> "$TESTDIR"/check-perf-code.py contrib/perf.py