upstream/mercurial-mirror Files · tests/test-static-http.t

changegroup: increase write buffer size to 128k...

changegroup: increase write buffer size to 128k By default, Python defers to the operating system for choosing the default buffer size on opened files. On my Linux machine, the default is 4k, which is really small for 2016. This patch bumps the write buffer size when writing changegroups/bundles to 128k. This matches the 128k read buffer we already use on revlogs. It's worth noting that this only impacts when writing to an explicit file (such as during `hg bundle`). Buffers when writing to bundle files via the repo vfs or to a temporary file are not impacted. When producing a none-v2 bundle file of the mozilla-unified repository, this change caused the number of write() system calls to drop from 952,449 to 29,788. After this change, the most frequent system calls are fstat(), read(), lseek(), and open(). There were 2,523,672 system calls after this patch (so a net decrease of ~950k is statistically significant). This change shows no performance change on my system. But I have a high-end system with a fast SSD. It is quite possible this change will have a significant impact on network file systems, where extra network round trips due to excessive I/O system calls could introduce significant latency.

Augie Fackler - - Load All Authors

File last commit:

r29514:28052824 default


                r30212:260af198

default

Download file

             test-static-http.t
        
                    157 lines
            
             | 4.1 KiB
            
                | text/troff
            
             |
                Tads3Lexer
            
             / tests / test-static-http.t
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #require killdaemons

        $ hg clone http://localhost:$HGPORT/ copy

        abort: * (glob)

        [255]

        $ test -d copy

        [1]

      This server doesn't do range requests so it's basically only good for

      one pull

        $ python "$TESTDIR/dumbhttp.py" -p $HGPORT --pid dumb.pid

        $ cat dumb.pid >> $DAEMON_PIDS

        $ hg init remote

        $ cd remote

        $ echo foo > bar

        $ echo c2 > '.dotfile with spaces'

        $ hg add

        adding .dotfile with spaces

        adding bar

        $ hg commit -m"test"

        $ hg tip

        changeset:   0:02770d679fb8

        tag:         tip

        user:        test

        date:        Thu Jan 01 00:00:00 1970 +0000

        summary:     test

        $ cd ..

        $ hg clone static-http://localhost:$HGPORT/remote local

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 2 changes to 2 files

        updating to branch default

        2 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        2 files, 1 changesets, 2 total revisions

        $ cat bar

        foo

        $ cd ../remote

        $ echo baz > quux

        $ hg commit -A -mtest2

        adding quux

      check for HTTP opener failures when cachefile does not exist

        $ rm .hg/cache/*

        $ cd ../local

        $ echo '[hooks]' >> .hg/hgrc

        $ echo "changegroup = printenv.py changegroup" >> .hg/hgrc

        $ hg pull

        pulling from static-http://localhost:$HGPORT/remote

        searching for changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 1 changes to 1 files

        changegroup hook: HG_NODE=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_NODE_LAST=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_SOURCE=pull HG_TXNID=TXN:* HG_URL=http://localhost:$HGPORT/remote (glob)

        (run 'hg update' to get a working copy)

      trying to push

        $ hg update

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ echo more foo >> bar

        $ hg commit -m"test"

        $ hg push

        pushing to static-http://localhost:$HGPORT/remote

        abort: destination does not support push

        [255]

      trying clone -r

        $ cd ..

        $ hg clone -r doesnotexist static-http://localhost:$HGPORT/remote local0

        abort: unknown revision 'doesnotexist'!

        [255]

        $ hg clone -r 0 static-http://localhost:$HGPORT/remote local0

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 2 changes to 2 files

        updating to branch default

        2 files updated, 0 files merged, 0 files removed, 0 files unresolved

      test with "/" URI (issue747) and subrepo

        $ hg init

        $ hg init sub

        $ touch sub/test

        $ hg -R sub commit -A -m "test"

        adding test

        $ hg -R sub tag not-empty

        $ echo sub=sub > .hgsub

        $ echo a > a

        $ hg add a .hgsub

        $ hg -q ci -ma

        $ hg clone static-http://localhost:$HGPORT/ local2

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 3 changes to 3 files

        updating to branch default

        cloning subrepo sub from static-http://localhost:$HGPORT/sub

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 2 changesets with 2 changes to 2 files

        3 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local2

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        3 files, 1 changesets, 3 total revisions

        checking subrepo links

        $ cat a

        a

        $ hg paths

        default = static-http://localhost:$HGPORT/

      test with empty repo (issue965)

        $ cd ..

        $ hg init remotempty

        $ hg clone static-http://localhost:$HGPORT/remotempty local3

        no changes found

        updating to branch default

        0 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local3

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        0 files, 0 changesets, 0 total revisions

        $ hg paths

        default = static-http://localhost:$HGPORT/remotempty

      test with non-repo

        $ cd ..

        $ mkdir notarepo

        $ hg clone static-http://localhost:$HGPORT/notarepo local3

        abort: 'http://localhost:$HGPORT/notarepo' does not appear to be an hg repository!

        [255]

        $ killdaemons.py

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#require killdaemons

				$ hg clone http://localhost:$HGPORT/ copy
				abort: * (glob)
				[255]
				$ test -d copy
				[1]

				This server doesn't do range requests so it's basically only good for
				one pull

				$ python "$TESTDIR/dumbhttp.py" -p $HGPORT --pid dumb.pid
				$ cat dumb.pid >> $DAEMON_PIDS
				$ hg init remote
				$ cd remote
				$ echo foo > bar
				$ echo c2 > '.dotfile with spaces'
				$ hg add
				adding .dotfile with spaces
				adding bar
				$ hg commit -m"test"
				$ hg tip
				changeset: 0:02770d679fb8
				tag: tip
				user: test
				date: Thu Jan 01 00:00:00 1970 +0000
				summary: test

				$ cd ..
				$ hg clone static-http://localhost:$HGPORT/remote local
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 2 changes to 2 files
				updating to branch default
				2 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				2 files, 1 changesets, 2 total revisions
				$ cat bar
				foo
				$ cd ../remote
				$ echo baz > quux
				$ hg commit -A -mtest2
				adding quux

				check for HTTP opener failures when cachefile does not exist

				$ rm .hg/cache/*
				$ cd ../local
				$ echo '[hooks]' >> .hg/hgrc
				$ echo "changegroup = printenv.py changegroup" >> .hg/hgrc
				$ hg pull
				pulling from static-http://localhost:$HGPORT/remote
				searching for changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 1 changes to 1 files
				changegroup hook: HG_NODE=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_NODE_LAST=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_SOURCE=pull HG_TXNID=TXN:* HG_URL=http://localhost:$HGPORT/remote (glob)
				(run 'hg update' to get a working copy)

				trying to push

				$ hg update
				1 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ echo more foo >> bar
				$ hg commit -m"test"
				$ hg push
				pushing to static-http://localhost:$HGPORT/remote
				abort: destination does not support push
				[255]

				trying clone -r

				$ cd ..
				$ hg clone -r doesnotexist static-http://localhost:$HGPORT/remote local0
				abort: unknown revision 'doesnotexist'!
				[255]
				$ hg clone -r 0 static-http://localhost:$HGPORT/remote local0
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 2 changes to 2 files
				updating to branch default
				2 files updated, 0 files merged, 0 files removed, 0 files unresolved

				test with "/" URI (issue747) and subrepo

				$ hg init
				$ hg init sub
				$ touch sub/test
				$ hg -R sub commit -A -m "test"
				adding test
				$ hg -R sub tag not-empty
				$ echo sub=sub > .hgsub
				$ echo a > a
				$ hg add a .hgsub
				$ hg -q ci -ma
				$ hg clone static-http://localhost:$HGPORT/ local2
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 3 changes to 3 files
				updating to branch default
				cloning subrepo sub from static-http://localhost:$HGPORT/sub
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 2 changesets with 2 changes to 2 files
				3 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local2
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				3 files, 1 changesets, 3 total revisions
				checking subrepo links
				$ cat a
				a
				$ hg paths
				default = static-http://localhost:$HGPORT/

				test with empty repo (issue965)

				$ cd ..
				$ hg init remotempty
				$ hg clone static-http://localhost:$HGPORT/remotempty local3
				no changes found
				updating to branch default
				0 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local3
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				0 files, 0 changesets, 0 total revisions
				$ hg paths
				default = static-http://localhost:$HGPORT/remotempty

				test with non-repo

				$ cd ..
				$ mkdir notarepo
				$ hg clone static-http://localhost:$HGPORT/notarepo local3
				abort: 'http://localhost:$HGPORT/notarepo' does not appear to be an hg repository!
				[255]
				$ killdaemons.py