upstream/mercurial-mirror Files · tests/test-clone-uncompressed.t

dispatch: protect against malicious 'hg serve --stdio' invocations (sec)...

dispatch: protect against malicious 'hg serve --stdio' invocations (sec) Some shared-ssh installations assume that 'hg serve --stdio' is a safe command to run for minimally trusted users. Unfortunately, the messy implementation of argument parsing here meant that trying to access a repo named '--debugger' would give the user a pdb prompt, thereby sidestepping any hoped-for sandboxing. Serving repositories over HTTP(S) is unaffected. We're not currently hardening any subcommands other than 'serve'. If your service exposes other commands to users with arbitrary repository names, it is imperative that you defend against repository names of '--debugger' and anything starting with '--config'. The read-only mode of hg-ssh stopped working because it provided its hook configuration to "hg serve --stdio" via --config parameter. This is banned for security reasons now. This patch switches it to directly call ui.setconfig(). If your custom hosting infrastructure relies on passing --config to "hg serve --stdio", you'll need to find a different way to get that configuration into Mercurial, either by using ui.setconfig() as hg-ssh does in this patch, or by placing an hgrc file someplace where Mercurial will read it. mitrandir@fb.com provided some extra fixes for the dispatch code and for hg-ssh in places that I overlooked.

Pierre-Yves David - - Load All Authors

File last commit:

r31252:e7a35f18 default


                r32050:77eaf953

4.1.3 stable

Download file

             test-clone-uncompressed.t
        
                    90 lines
            
             | 2.6 KiB
            
                | text/troff
            
             |
                Tads3Lexer
            
             / tests / test-clone-uncompressed.t
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Gregory Szorc
    
streamclone: use backgroundfilecloser (issue4889)...

              r27897
            
      #require serve

        timeless
    
bdiff: (pure) support array.array arrays (issue5130)

              r28389
            
      Initialize repository

      the status call is to check for issue5130

        Gregory Szorc
    
streamclone: use backgroundfilecloser (issue4889)...

              r27897
            
        $ hg init server

        $ cd server

        $ touch foo

        $ hg -q commit -A -m initial

        >>> for i in range(1024):

        ...     with open(str(i), 'wb') as fh:

        ...         fh.write(str(i))

        $ hg -q commit -A -m 'add a lot of files'

        timeless
    
bdiff: (pure) support array.array arrays (issue5130)

              r28389
            
        $ hg st

        Gregory Szorc
    
streamclone: use backgroundfilecloser (issue4889)...

              r27897
            
        $ hg serve -p $HGPORT -d --pid-file=hg.pid

        $ cat hg.pid >> $DAEMON_PIDS

        $ cd ..

      Basic clone

        $ hg clone --uncompressed -U http://localhost:$HGPORT clone1

        streaming all changes

        1027 files to transfer, 96.3 KB of data

        transferred 96.3 KB in * seconds (*/sec) (glob)

        searching for changes

        no changes found

      Clone with background file closing enabled

        $ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --uncompressed -U http://localhost:$HGPORT clone-background | grep -v adding

        using http://localhost:$HGPORT/

        sending capabilities command

        sending branchmap command

        streaming all changes

        sending stream_out command

        1027 files to transfer, 96.3 KB of data

        starting 4 threads for background file closing

        transferred 96.3 KB in * seconds (*/sec) (glob)

        query 1; heads

        sending batch command

        searching for changes

        all remote heads known locally

        no changes found

        sending getbundle command

        bundle2-input-bundle: with-transaction

        bundle2-input-part: "listkeys" (params: 1 mandatory) supported

        Mike Hommey
    
bundle2: properly request phases during getbundle...

              r29064
            
        bundle2-input-part: total payload size 58

        Gregory Szorc
    
streamclone: use backgroundfilecloser (issue4889)...

              r27897
            
        bundle2-input-part: "listkeys" (params: 1 mandatory) supported

        bundle2-input-bundle: 1 parts total

        checking for updated bookmarks

        Mads Kiilerich
    
tests: add test of stream clone of repo that is changing...

              r28517
            
      Stream clone while repo is changing:

        $ mkdir changing

        $ cd changing

      extension for delaying the server process so we reliably can modify the repo

      while cloning

        $ cat > delayer.py <<EOF

        > import time

        > from mercurial import extensions, scmutil

        > def __call__(orig, self, path, *args, **kwargs):

        >     if path == 'data/f1.i':

        >         time.sleep(2)

        >     return orig(self, path, *args, **kwargs)

        > extensions.wrapfunction(scmutil.vfs, '__call__', __call__)

        > EOF

      prepare repo with small and big file to cover both code paths in emitrevlogdata

        $ hg init repo

        $ touch repo/f1

        $ $TESTDIR/seq.py 50000 > repo/f2

        $ hg -R repo ci -Aqm "0"

        $ hg -R repo serve -p $HGPORT1 -d --pid-file=hg.pid --config extensions.delayer=delayer.py

        $ cat hg.pid >> $DAEMON_PIDS

      clone while modifying the repo between stating file with write lock and

      actually serving file content

        $ hg clone -q --uncompressed -U http://localhost:$HGPORT1 clone &

        $ sleep 1

        $ echo >> repo/f1

        $ echo >> repo/f2

        $ hg -R repo ci -m "1"

        $ wait

        $ hg -R clone id

        Mads Kiilerich
    
streamclone: fix error when store files grow while stream cloning...

              r28518
            
        000000000000

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Gregory Szorc streamclone: use backgroundfilecloser (issue4889)...	r27897	#require serve

timeless bdiff: (pure) support array.array arrays (issue5130)	r28389	Initialize repository
		the status call is to check for issue5130

Gregory Szorc streamclone: use backgroundfilecloser (issue4889)...	r27897	$ hg init server
		$ cd server
		$ touch foo
		$ hg -q commit -A -m initial
		>>> for i in range(1024):
		... with open(str(i), 'wb') as fh:
		... fh.write(str(i))
		$ hg -q commit -A -m 'add a lot of files'
timeless bdiff: (pure) support array.array arrays (issue5130)	r28389	$ hg st
Gregory Szorc streamclone: use backgroundfilecloser (issue4889)...	r27897	$ hg serve -p $HGPORT -d --pid-file=hg.pid
		$ cat hg.pid >> $DAEMON_PIDS
		$ cd ..

		Basic clone

		$ hg clone --uncompressed -U http://localhost:$HGPORT clone1
		streaming all changes
		1027 files to transfer, 96.3 KB of data
		transferred 96.3 KB in * seconds (*/sec) (glob)
		searching for changes
		no changes found

		Clone with background file closing enabled

		$ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --uncompressed -U http://localhost:$HGPORT clone-background \| grep -v adding
		using http://localhost:$HGPORT/
		sending capabilities command
		sending branchmap command
		streaming all changes
		sending stream_out command
		1027 files to transfer, 96.3 KB of data
		starting 4 threads for background file closing
		transferred 96.3 KB in * seconds (*/sec) (glob)
		query 1; heads
		sending batch command
		searching for changes
		all remote heads known locally
		no changes found
		sending getbundle command
		bundle2-input-bundle: with-transaction
		bundle2-input-part: "listkeys" (params: 1 mandatory) supported
Mike Hommey bundle2: properly request phases during getbundle...	r29064	bundle2-input-part: total payload size 58
Gregory Szorc streamclone: use backgroundfilecloser (issue4889)...	r27897	bundle2-input-part: "listkeys" (params: 1 mandatory) supported
		bundle2-input-bundle: 1 parts total
		checking for updated bookmarks
Mads Kiilerich tests: add test of stream clone of repo that is changing...	r28517

		Stream clone while repo is changing:

		$ mkdir changing
		$ cd changing

		extension for delaying the server process so we reliably can modify the repo
		while cloning

		$ cat > delayer.py <<EOF
		> import time
		> from mercurial import extensions, scmutil
		> def __call__(orig, self, path, args, *kwargs):
		> if path == 'data/f1.i':
		> time.sleep(2)
		> return orig(self, path, args, *kwargs)
		> extensions.wrapfunction(scmutil.vfs, '__call__', __call__)
		> EOF

		prepare repo with small and big file to cover both code paths in emitrevlogdata

		$ hg init repo
		$ touch repo/f1
		$ $TESTDIR/seq.py 50000 > repo/f2
		$ hg -R repo ci -Aqm "0"
		$ hg -R repo serve -p $HGPORT1 -d --pid-file=hg.pid --config extensions.delayer=delayer.py
		$ cat hg.pid >> $DAEMON_PIDS

		clone while modifying the repo between stating file with write lock and
		actually serving file content

		$ hg clone -q --uncompressed -U http://localhost:$HGPORT1 clone &
		$ sleep 1
		$ echo >> repo/f1
		$ echo >> repo/f2
		$ hg -R repo ci -m "1"
		$ wait
		$ hg -R clone id
Mads Kiilerich streamclone: fix error when store files grow while stream cloning...	r28518	000000000000