upstream/mercurial-mirror Files · tests/test-static-http.t

wireprotov2: define and implement "manifestdata" command...

wireprotov2: define and implement "manifestdata" command The added command can be used for obtaining manifest data. Given a manifest path and set of manifest nodes, data about manifests can be retrieved. Unlike changeset data, we wish to emit deltas to describe manifest revisions. So the command uses the relatively new API for building delta requests and emitting them. The code calls into deltaparent(), which I'm not very keen of. There's still work to be done in delta generation land so implementation details of storage (e.g. exactly one delta is stored/available) don't creep into higher levels. But we can worry about this later (there is already a TODO on imanifestorage tracking this). On the subject of parent deltas, the server assumes parent revisions exist on the receiving end. This is obviously wrong for shallow clone. I've added TODOs to add a mechanism to the command to allow clients to specify desired behavior. This shouldn't be too difficult to implement. Another big change is that the client must explicitly request manifest nodes to retrieve. This is a major departure from "getbundle," where the server derives relevant manifests as it iterates changesets and sends them automatically. As implemented, the client must transmit each requested node to the server. At 20 bytes per node, we're looking at 2 MB per 100,000 nodes. Plus wire encoding overhead. This isn't ideal for clients with limited upload bandwidth. I plan to address this in the future by allowing alternate mechanisms for defining the revisions to retrieve. One idea is to define a range of changeset revisions whose manifest revisions to retrieve (similar to how "changesetdata" works). We almost certainly want an API to look up an individual manifest by node. And that's where I've chosen to start with the implementation. Again, a theme of this early exchangev2 work is I want to start by building primitives for accessing raw repository data first and see how far we can get with those before we need more complexity. Differential Revision: https://phab.mercurial-scm.org/D4488

Meirambek Omyrzak - - Load All Authors

File last commit:

r39525:f1186c29 default


                r39673:c7a7c7e8

default

Download file

             test-static-http.t
        
                    279 lines
            
             | 7.9 KiB
            
                | text/troff
            
             |
                Tads3Lexer
            
             / tests / test-static-http.t
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #require no-reposimplestore

        $ hg clone http://localhost:$HGPORT/ copy

        abort: * (glob)

        [255]

        $ test -d copy

        [1]

      This server doesn't do range requests so it's basically only good for

      one pull

        $ $PYTHON "$TESTDIR/dumbhttp.py" -p $HGPORT --pid dumb.pid \

        > --logfile server.log

        $ cat dumb.pid >> $DAEMON_PIDS

        $ hg init remote

        $ cd remote

        $ echo foo > bar

        $ echo c2 > '.dotfile with spaces'

        $ hg add

        adding .dotfile with spaces

        adding bar

        $ hg commit -m"test"

        $ hg tip

        changeset:   0:02770d679fb8

        tag:         tip

        user:        test

        date:        Thu Jan 01 00:00:00 1970 +0000

        summary:     test

        $ cd ..

        $ hg clone static-http://localhost:$HGPORT/remote local

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 2 changes to 2 files

        new changesets 02770d679fb8

        updating to branch default

        2 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        checked 1 changesets with 2 changes to 2 files

        $ cat bar

        foo

        $ cd ../remote

        $ echo baz > quux

        $ hg commit -A -mtest2

        adding quux

      check for HTTP opener failures when cachefile does not exist

        $ rm .hg/cache/*

        $ cd ../local

        $ cat >> .hg/hgrc <<EOF

        > [hooks]

        > changegroup = sh -c "printenv.py changegroup"

        > EOF

        $ hg pull

        pulling from static-http://localhost:$HGPORT/remote

        searching for changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 1 changes to 1 files

        new changesets 4ac2e3648604

        changegroup hook: HG_HOOKNAME=changegroup HG_HOOKTYPE=changegroup HG_NODE=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_NODE_LAST=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_SOURCE=pull HG_TXNID=TXN:$ID$ HG_URL=http://localhost:$HGPORT/remote

        (run 'hg update' to get a working copy)

      trying to push

        $ hg update

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ echo more foo >> bar

        $ hg commit -m"test"

        $ hg push

        pushing to static-http://localhost:$HGPORT/remote

        abort: destination does not support push

        [255]

      trying clone -r

        $ cd ..

        $ hg clone -r doesnotexist static-http://localhost:$HGPORT/remote local0

        abort: unknown revision 'doesnotexist'!

        [255]

        $ hg clone -r 0 static-http://localhost:$HGPORT/remote local0

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 2 changes to 2 files

        new changesets 02770d679fb8

        updating to branch default

        2 files updated, 0 files merged, 0 files removed, 0 files unresolved

      test with "/" URI (issue747) and subrepo

        $ hg init

        $ hg init sub

        $ touch sub/test

        $ hg -R sub commit -A -m "test"

        adding test

        $ hg -R sub tag not-empty

        $ echo sub=sub > .hgsub

        $ echo a > a

        $ hg add a .hgsub

        $ hg -q ci -ma

        $ hg clone static-http://localhost:$HGPORT/ local2

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 3 changes to 3 files

        new changesets a9ebfbe8e587

        updating to branch default

        cloning subrepo sub from static-http://localhost:$HGPORT/sub

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 2 changesets with 2 changes to 2 files

        new changesets be090ea66256:322ea90975df

        3 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local2

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        checked 1 changesets with 3 changes to 3 files

        checking subrepo links

        $ cat a

        a

        $ hg paths

        default = static-http://localhost:$HGPORT/

      test with empty repo (issue965)

        $ cd ..

        $ hg init remotempty

        $ hg clone static-http://localhost:$HGPORT/remotempty local3

        no changes found

        updating to branch default

        0 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ cd local3

        $ hg verify

        checking changesets

        checking manifests

        crosschecking files in changesets and manifests

        checking files

        checked 0 changesets with 0 changes to 0 files

        $ hg paths

        default = static-http://localhost:$HGPORT/remotempty

      test with non-repo

        $ cd ..

        $ mkdir notarepo

        $ hg clone static-http://localhost:$HGPORT/notarepo local3

        abort: 'http://localhost:$HGPORT/notarepo' does not appear to be an hg repository!

        [255]

      Clone with tags and branches works

        $ hg init remote-with-names

        $ cd remote-with-names

        $ echo 0 > foo

        $ hg -q commit -A -m initial

        $ echo 1 > foo

        $ hg commit -m 'commit 1'

        $ hg -q up 0

        $ hg branch mybranch

        marked working directory as branch mybranch

        (branches are permanent and global, did you want a bookmark?)

        $ echo 2 > foo

        $ hg commit -m 'commit 2 (mybranch)'

        $ hg tag -r 1 'default-tag'

        $ hg tag -r 2 'branch-tag'

        $ cd ..

        $ hg clone static-http://localhost:$HGPORT/remote-with-names local-with-names

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 5 changesets with 5 changes to 2 files (+1 heads)

        new changesets 68986213bd44:0c325bd2b5a7

        updating to branch default

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

      Clone a specific branch works

        $ hg clone -r mybranch static-http://localhost:$HGPORT/remote-with-names local-with-names-branch

        adding changesets

        adding manifests

        adding file changes

        added 4 changesets with 4 changes to 2 files

        new changesets 68986213bd44:0c325bd2b5a7

        updating to branch mybranch

        2 files updated, 0 files merged, 0 files removed, 0 files unresolved

      Clone a specific tag works

        $ hg clone -r default-tag static-http://localhost:$HGPORT/remote-with-names local-with-names-tag

        adding changesets

        adding manifests

        adding file changes

        added 2 changesets with 2 changes to 1 files

        new changesets 68986213bd44:4ee3fcef1c80

        updating to branch default

        1 files updated, 0 files merged, 0 files removed, 0 files unresolved

        $ killdaemons.py

      List of files accessed over HTTP:

        $ cat server.log | sed -n -e 's|.*GET \(/[^ ]*\).*|\1|p' | sort -u

        /.hg/bookmarks

        /.hg/bookmarks.current

        /.hg/cache/hgtagsfnodes1

        /.hg/cache/rbc-names-v1

        /.hg/cache/rbc-revs-v1

        /.hg/requires

        /.hg/store/00changelog.i

        /.hg/store/00manifest.i

        /.hg/store/data/%7E2ehgsub.i

        /.hg/store/data/%7E2ehgsubstate.i

        /.hg/store/data/a.i

        /notarepo/.hg/00changelog.i

        /notarepo/.hg/requires

        /remote-with-names/.hg/bookmarks

        /remote-with-names/.hg/bookmarks.current

        /remote-with-names/.hg/cache/branch2-served

        /remote-with-names/.hg/cache/hgtagsfnodes1

        /remote-with-names/.hg/cache/rbc-names-v1

        /remote-with-names/.hg/cache/rbc-revs-v1

        /remote-with-names/.hg/cache/tags2-served

        /remote-with-names/.hg/localtags

        /remote-with-names/.hg/requires

        /remote-with-names/.hg/store/00changelog.i

        /remote-with-names/.hg/store/00manifest.i

        /remote-with-names/.hg/store/data/%7E2ehgtags.i

        /remote-with-names/.hg/store/data/foo.i

        /remote/.hg/bookmarks

        /remote/.hg/bookmarks.current

        /remote/.hg/cache/branch2-base

        /remote/.hg/cache/branch2-immutable

        /remote/.hg/cache/branch2-served

        /remote/.hg/cache/hgtagsfnodes1

        /remote/.hg/cache/rbc-names-v1

        /remote/.hg/cache/rbc-revs-v1

        /remote/.hg/cache/tags2-served

        /remote/.hg/localtags

        /remote/.hg/requires

        /remote/.hg/store/00changelog.i

        /remote/.hg/store/00manifest.i

        /remote/.hg/store/data/%7E2edotfile%20with%20spaces.i

        /remote/.hg/store/data/%7E2ehgtags.i

        /remote/.hg/store/data/bar.i

        /remote/.hg/store/data/quux.i

        /remotempty/.hg/bookmarks

        /remotempty/.hg/bookmarks.current

        /remotempty/.hg/requires

        /remotempty/.hg/store/00changelog.i

        /remotempty/.hg/store/00manifest.i

        /sub/.hg/bookmarks

        /sub/.hg/bookmarks.current

        /sub/.hg/cache/hgtagsfnodes1

        /sub/.hg/cache/rbc-names-v1

        /sub/.hg/cache/rbc-revs-v1

        /sub/.hg/requires

        /sub/.hg/store/00changelog.i

        /sub/.hg/store/00manifest.i

        /sub/.hg/store/data/%7E2ehgtags.i

        /sub/.hg/store/data/test.i

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#require no-reposimplestore

				$ hg clone http://localhost:$HGPORT/ copy
				abort: * (glob)
				[255]
				$ test -d copy
				[1]

				This server doesn't do range requests so it's basically only good for
				one pull

				$ $PYTHON "$TESTDIR/dumbhttp.py" -p $HGPORT --pid dumb.pid \
				> --logfile server.log
				$ cat dumb.pid >> $DAEMON_PIDS
				$ hg init remote
				$ cd remote
				$ echo foo > bar
				$ echo c2 > '.dotfile with spaces'
				$ hg add
				adding .dotfile with spaces
				adding bar
				$ hg commit -m"test"
				$ hg tip
				changeset: 0:02770d679fb8
				tag: tip
				user: test
				date: Thu Jan 01 00:00:00 1970 +0000
				summary: test

				$ cd ..
				$ hg clone static-http://localhost:$HGPORT/remote local
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 2 changes to 2 files
				new changesets 02770d679fb8
				updating to branch default
				2 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				checked 1 changesets with 2 changes to 2 files
				$ cat bar
				foo
				$ cd ../remote
				$ echo baz > quux
				$ hg commit -A -mtest2
				adding quux

				check for HTTP opener failures when cachefile does not exist

				$ rm .hg/cache/*
				$ cd ../local
				$ cat >> .hg/hgrc <<EOF
				> [hooks]
				> changegroup = sh -c "printenv.py changegroup"
				> EOF
				$ hg pull
				pulling from static-http://localhost:$HGPORT/remote
				searching for changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 1 changes to 1 files
				new changesets 4ac2e3648604
				changegroup hook: HG_HOOKNAME=changegroup HG_HOOKTYPE=changegroup HG_NODE=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_NODE_LAST=4ac2e3648604439c580c69b09ec9d93a88d93432 HG_SOURCE=pull HG_TXNID=TXN:$ID$ HG_URL=http://localhost:$HGPORT/remote
				(run 'hg update' to get a working copy)

				trying to push

				$ hg update
				1 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ echo more foo >> bar
				$ hg commit -m"test"
				$ hg push
				pushing to static-http://localhost:$HGPORT/remote
				abort: destination does not support push
				[255]

				trying clone -r

				$ cd ..
				$ hg clone -r doesnotexist static-http://localhost:$HGPORT/remote local0
				abort: unknown revision 'doesnotexist'!
				[255]
				$ hg clone -r 0 static-http://localhost:$HGPORT/remote local0
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 2 changes to 2 files
				new changesets 02770d679fb8
				updating to branch default
				2 files updated, 0 files merged, 0 files removed, 0 files unresolved

				test with "/" URI (issue747) and subrepo

				$ hg init
				$ hg init sub
				$ touch sub/test
				$ hg -R sub commit -A -m "test"
				adding test
				$ hg -R sub tag not-empty
				$ echo sub=sub > .hgsub
				$ echo a > a
				$ hg add a .hgsub
				$ hg -q ci -ma
				$ hg clone static-http://localhost:$HGPORT/ local2
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 3 changes to 3 files
				new changesets a9ebfbe8e587
				updating to branch default
				cloning subrepo sub from static-http://localhost:$HGPORT/sub
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 2 changesets with 2 changes to 2 files
				new changesets be090ea66256:322ea90975df
				3 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local2
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				checked 1 changesets with 3 changes to 3 files
				checking subrepo links
				$ cat a
				a
				$ hg paths
				default = static-http://localhost:$HGPORT/

				test with empty repo (issue965)

				$ cd ..
				$ hg init remotempty
				$ hg clone static-http://localhost:$HGPORT/remotempty local3
				no changes found
				updating to branch default
				0 files updated, 0 files merged, 0 files removed, 0 files unresolved
				$ cd local3
				$ hg verify
				checking changesets
				checking manifests
				crosschecking files in changesets and manifests
				checking files
				checked 0 changesets with 0 changes to 0 files
				$ hg paths
				default = static-http://localhost:$HGPORT/remotempty

				test with non-repo

				$ cd ..
				$ mkdir notarepo
				$ hg clone static-http://localhost:$HGPORT/notarepo local3
				abort: 'http://localhost:$HGPORT/notarepo' does not appear to be an hg repository!
				[255]

				Clone with tags and branches works

				$ hg init remote-with-names
				$ cd remote-with-names
				$ echo 0 > foo
				$ hg -q commit -A -m initial
				$ echo 1 > foo
				$ hg commit -m 'commit 1'
				$ hg -q up 0
				$ hg branch mybranch
				marked working directory as branch mybranch
				(branches are permanent and global, did you want a bookmark?)
				$ echo 2 > foo
				$ hg commit -m 'commit 2 (mybranch)'
				$ hg tag -r 1 'default-tag'
				$ hg tag -r 2 'branch-tag'

				$ cd ..

				$ hg clone static-http://localhost:$HGPORT/remote-with-names local-with-names
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 5 changesets with 5 changes to 2 files (+1 heads)
				new changesets 68986213bd44:0c325bd2b5a7
				updating to branch default
				1 files updated, 0 files merged, 0 files removed, 0 files unresolved

				Clone a specific branch works

				$ hg clone -r mybranch static-http://localhost:$HGPORT/remote-with-names local-with-names-branch
				adding changesets
				adding manifests
				adding file changes
				added 4 changesets with 4 changes to 2 files
				new changesets 68986213bd44:0c325bd2b5a7
				updating to branch mybranch
				2 files updated, 0 files merged, 0 files removed, 0 files unresolved

				Clone a specific tag works

				$ hg clone -r default-tag static-http://localhost:$HGPORT/remote-with-names local-with-names-tag
				adding changesets
				adding manifests
				adding file changes
				added 2 changesets with 2 changes to 1 files
				new changesets 68986213bd44:4ee3fcef1c80
				updating to branch default
				1 files updated, 0 files merged, 0 files removed, 0 files unresolved

				$ killdaemons.py

				List of files accessed over HTTP:

				$ cat server.log \| sed -n -e 's\|.GET \(/[^ ]\).*\|\1\|p' \| sort -u
				/.hg/bookmarks
				/.hg/bookmarks.current
				/.hg/cache/hgtagsfnodes1
				/.hg/cache/rbc-names-v1
				/.hg/cache/rbc-revs-v1
				/.hg/requires
				/.hg/store/00changelog.i
				/.hg/store/00manifest.i
				/.hg/store/data/%7E2ehgsub.i
				/.hg/store/data/%7E2ehgsubstate.i
				/.hg/store/data/a.i
				/notarepo/.hg/00changelog.i
				/notarepo/.hg/requires
				/remote-with-names/.hg/bookmarks
				/remote-with-names/.hg/bookmarks.current
				/remote-with-names/.hg/cache/branch2-served
				/remote-with-names/.hg/cache/hgtagsfnodes1
				/remote-with-names/.hg/cache/rbc-names-v1
				/remote-with-names/.hg/cache/rbc-revs-v1
				/remote-with-names/.hg/cache/tags2-served
				/remote-with-names/.hg/localtags
				/remote-with-names/.hg/requires
				/remote-with-names/.hg/store/00changelog.i
				/remote-with-names/.hg/store/00manifest.i
				/remote-with-names/.hg/store/data/%7E2ehgtags.i
				/remote-with-names/.hg/store/data/foo.i
				/remote/.hg/bookmarks
				/remote/.hg/bookmarks.current
				/remote/.hg/cache/branch2-base
				/remote/.hg/cache/branch2-immutable
				/remote/.hg/cache/branch2-served
				/remote/.hg/cache/hgtagsfnodes1
				/remote/.hg/cache/rbc-names-v1
				/remote/.hg/cache/rbc-revs-v1
				/remote/.hg/cache/tags2-served
				/remote/.hg/localtags
				/remote/.hg/requires
				/remote/.hg/store/00changelog.i
				/remote/.hg/store/00manifest.i
				/remote/.hg/store/data/%7E2edotfile%20with%20spaces.i
				/remote/.hg/store/data/%7E2ehgtags.i
				/remote/.hg/store/data/bar.i
				/remote/.hg/store/data/quux.i
				/remotempty/.hg/bookmarks
				/remotempty/.hg/bookmarks.current
				/remotempty/.hg/requires
				/remotempty/.hg/store/00changelog.i
				/remotempty/.hg/store/00manifest.i
				/sub/.hg/bookmarks
				/sub/.hg/bookmarks.current
				/sub/.hg/cache/hgtagsfnodes1
				/sub/.hg/cache/rbc-names-v1
				/sub/.hg/cache/rbc-revs-v1
				/sub/.hg/requires
				/sub/.hg/store/00changelog.i
				/sub/.hg/store/00manifest.i
				/sub/.hg/store/data/%7E2ehgtags.i
				/sub/.hg/store/data/test.i