##// END OF EJS Templates
streamclone: remove sleep based "synchronisation" in tests...
streamclone: remove sleep based "synchronisation" in tests Sleep based test synchronisation does not work. Variation in machine performance and load can make the two process miss their windows. Instead we migrate to explicit signaling through the file system as other tests file are using. Differential Revision: https://phab.mercurial-scm.org/D10478

File last commit:

r47748:faa43f09 default
r47748:faa43f09 default
Show More
test-clone-uncompressed.t
671 lines | 23.6 KiB | text/troff | Tads3Lexer
/ tests / test-clone-uncompressed.t
Kyle Lippincott
tests: mark tests that fail when using chg as #require no-chg...
r38041 #require serve no-reposimplestore no-chg
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #testcases stream-legacy stream-bundle2
av6
bundle2: make server.bundle2.stream default to True...
r39758 #if stream-legacy
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 $ cat << EOF >> $HGRCPATH
av6
bundle2: graduate bundle2.stream option from experimental to server section...
r39757 > [server]
av6
bundle2: make server.bundle2.stream default to True...
r39758 > bundle2.stream = no
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 > EOF
#endif
timeless
bdiff: (pure) support array.array arrays (issue5130)
r28389 Initialize repository
the status call is to check for issue5130
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ hg init server
$ cd server
$ touch foo
$ hg -q commit -A -m initial
>>> for i in range(1024):
... with open(str(i), 'wb') as fh:
Pulkit Goyal
py3: use b"%d" instead of str() to convert int to bytes...
r37685 ... fh.write(b"%d" % i) and None
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ hg -q commit -A -m 'add a lot of files'
timeless
bdiff: (pure) support array.array arrays (issue5130)
r28389 $ hg st
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ hg --config server.uncompressed=false serve -p $HGPORT -d --pid-file=hg.pid
$ cat hg.pid > $DAEMON_PIDS
$ cd ..
Cannot stream clone when server.uncompressed is set
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=stream_out'
200 Script output follows
1
#if stream-legacy
$ hg debugcapabilities http://localhost:$HGPORT
Main capabilities:
batch
branchmap
Gregory Szorc
bundle2: always advertise client support for stream parts...
r35810 $USUAL_BUNDLE2_CAPS_SERVER$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 changegroupsubset
Augie Fackler
tests: add a pattern to fix --pure tests...
r35824 compression=$BUNDLE2_COMPRESSIONS$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 getbundle
httpheader=1024
httpmediatype=0.1rx,0.1tx,0.2tx
known
lookup
pushkey
unbundle=HG10GZ,HG10BZ,HG10UN
unbundlehash
Bundle2 capabilities:
HG20
bookmarks
changegroup
01
02
Valentin Gatien-Baron
exchange: turn on option that makes concurrent pushes work better...
r44896 checkheads
related
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 digests
md5
sha1
sha512
error
abort
unsupportedcontent
pushraced
pushkey
hgtagsfnodes
listkeys
phases
heads
pushkey
remote-changegroup
http
https
$ hg clone --stream -U http://localhost:$HGPORT server-disabled
warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 2 changesets with 1025 changes to 1025 files
new changesets 96ee1d7354c4:c17445101a72
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto 0.2 --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size body --hexdump --bytes 100
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 body: size=232
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 0010: cf 0b 45 52 52 4f 52 3a 41 42 4f 52 54 00 00 00 |..ERROR:ABORT...|
0020: 00 01 01 07 3c 04 72 6d 65 73 73 61 67 65 73 74 |....<.rmessagest|
0030: 72 65 61 6d 20 64 61 74 61 20 72 65 71 75 65 73 |ream data reques|
0040: 74 65 64 20 62 75 74 20 73 65 72 76 65 72 20 64 |ted but server d|
0050: 6f 65 73 20 6e 6f 74 20 61 6c 6c 6f 77 20 74 68 |oes not allow th|
0060: 69 73 20 66 |is f|
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807
#endif
#if stream-bundle2
$ hg debugcapabilities http://localhost:$HGPORT
Main capabilities:
batch
branchmap
Gregory Szorc
bundle2: always advertise client support for stream parts...
r35810 $USUAL_BUNDLE2_CAPS_SERVER$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 changegroupsubset
Augie Fackler
tests: add a pattern to fix --pure tests...
r35824 compression=$BUNDLE2_COMPRESSIONS$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 getbundle
httpheader=1024
httpmediatype=0.1rx,0.1tx,0.2tx
known
lookup
pushkey
unbundle=HG10GZ,HG10BZ,HG10UN
unbundlehash
Bundle2 capabilities:
HG20
bookmarks
changegroup
01
02
Valentin Gatien-Baron
exchange: turn on option that makes concurrent pushes work better...
r44896 checkheads
related
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 digests
md5
sha1
sha512
error
abort
unsupportedcontent
pushraced
pushkey
hgtagsfnodes
listkeys
phases
heads
pushkey
remote-changegroup
http
https
$ hg clone --stream -U http://localhost:$HGPORT server-disabled
warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 2 changesets with 1025 changes to 1025 files
new changesets 96ee1d7354c4:c17445101a72
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto 0.2 --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size body --hexdump --bytes 100
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 body: size=232
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 0010: cf 0b 45 52 52 4f 52 3a 41 42 4f 52 54 00 00 00 |..ERROR:ABORT...|
0020: 00 01 01 07 3c 04 72 6d 65 73 73 61 67 65 73 74 |....<.rmessagest|
0030: 72 65 61 6d 20 64 61 74 61 20 72 65 71 75 65 73 |ream data reques|
0040: 74 65 64 20 62 75 74 20 73 65 72 76 65 72 20 64 |ted but server d|
0050: 6f 65 73 20 6e 6f 74 20 61 6c 6c 6f 77 20 74 68 |oes not allow th|
0060: 69 73 20 66 |is f|
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807
#endif
$ killdaemons.py
$ cd server
streamclone: check the errors log in tests...
r47745 $ hg serve -p $HGPORT -d --pid-file=hg.pid --error errors.txt
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ cat hg.pid > $DAEMON_PIDS
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ cd ..
Basic clone
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT clone1
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 searching for changes
no changes found
streamclone: check the errors log in tests...
r47745 $ cat server/errors.txt
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream -U http://localhost:$HGPORT clone1
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (*/sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: also stream caches to the client...
r35785
$ ls -1 clone1/.hg/cache
clone: make sure we warm the cache after a clone...
r47032 branch2-base
branch2-immutable
Boris Feld
streamclone: also stream caches to the client...
r35785 branch2-served
clone: make sure we warm the cache after a clone...
r47032 branch2-served.hidden
branch2-visible
branch2-visible-hidden
hgtagsfnodes1
Boris Feld
streamclone: also stream caches to the client...
r35785 rbc-names-v1
rbc-revs-v1
clone: make sure we warm the cache after a clone...
r47032 tags2
tags2-served
streamclone: check the errors log in tests...
r47745 $ cat server/errors.txt
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805 getbundle requests with stream=1 are uncompressed
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto '0.1 0.2 comp=zlib,none' --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size --hex --bytes 256 body
revlog-compression: use zstd by default (if available)...
r47636 body: size=112262 (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 body: size=109410 (zstd no-rust !)
body: size=109431 (rust !)
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
revlog-compression: use zstd by default (if available)...
r47636 0010: 7f 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (no-zstd !)
0020: 05 09 04 0c 44 62 79 74 65 63 6f 75 6e 74 39 38 |....Dbytecount98| (no-zstd !)
0030: 37 37 35 66 69 6c 65 63 6f 75 6e 74 31 30 33 30 |775filecount1030| (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 0010: 99 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (zstd no-rust !)
0010: ae 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (rust !)
0020: 05 09 04 0c 5e 62 79 74 65 63 6f 75 6e 74 39 35 |....^bytecount95| (zstd no-rust !)
0020: 05 09 04 0c 73 62 79 74 65 63 6f 75 6e 74 39 35 |....sbytecount95| (rust !)
revlog-compression: use zstd by default (if available)...
r47636 0030: 38 39 37 66 69 6c 65 63 6f 75 6e 74 31 30 33 30 |897filecount1030| (zstd !)
Gregory Szorc
bundle2: move version of stream clone into part name...
r35806 0040: 72 65 71 75 69 72 65 6d 65 6e 74 73 64 6f 74 65 |requirementsdote|
Boris Feld
bundle2: fix the formatting of the stream part requirements...
r35831 0050: 6e 63 6f 64 65 25 32 43 66 6e 63 61 63 68 65 25 |ncode%2Cfncache%|
0060: 32 43 67 65 6e 65 72 61 6c 64 65 6c 74 61 25 32 |2Cgeneraldelta%2|
revlog-compression: use zstd by default (if available)...
r47636 0070: 43 72 65 76 6c 6f 67 76 31 25 32 43 73 70 61 72 |Crevlogv1%2Cspar| (no-zstd !)
0080: 73 65 72 65 76 6c 6f 67 25 32 43 73 74 6f 72 65 |serevlog%2Cstore| (no-zstd !)
0090: 00 00 80 00 73 08 42 64 61 74 61 2f 30 2e 69 00 |....s.Bdata/0.i.| (no-zstd !)
00a0: 03 00 01 00 00 00 00 00 00 00 02 00 00 00 01 00 |................| (no-zstd !)
00b0: 00 00 00 00 00 00 01 ff ff ff ff ff ff ff ff 80 |................| (no-zstd !)
00c0: 29 63 a0 49 d3 23 87 bf ce fe 56 67 92 67 2c 69 |)c.I.#....Vg.g,i| (no-zstd !)
00d0: d1 ec 39 00 00 00 00 00 00 00 00 00 00 00 00 75 |..9............u| (no-zstd !)
00e0: 30 73 08 42 64 61 74 61 2f 31 2e 69 00 03 00 01 |0s.Bdata/1.i....| (no-zstd !)
00f0: 00 00 00 00 00 00 00 02 00 00 00 01 00 00 00 00 |................| (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 0070: 43 72 65 76 6c 6f 67 2d 63 6f 6d 70 72 65 73 73 |Crevlog-compress| (zstd no-rust !)
0070: 43 70 65 72 73 69 73 74 65 6e 74 2d 6e 6f 64 65 |Cpersistent-node| (rust !)
0080: 69 6f 6e 2d 7a 73 74 64 25 32 43 72 65 76 6c 6f |ion-zstd%2Crevlo| (zstd no-rust !)
0080: 6d 61 70 25 32 43 72 65 76 6c 6f 67 2d 63 6f 6d |map%2Crevlog-com| (rust !)
0090: 67 76 31 25 32 43 73 70 61 72 73 65 72 65 76 6c |gv1%2Csparserevl| (zstd no-rust !)
0090: 70 72 65 73 73 69 6f 6e 2d 7a 73 74 64 25 32 43 |pression-zstd%2C| (rust !)
00a0: 6f 67 25 32 43 73 74 6f 72 65 00 00 80 00 73 08 |og%2Cstore....s.| (zstd no-rust !)
00a0: 72 65 76 6c 6f 67 76 31 25 32 43 73 70 61 72 73 |revlogv1%2Cspars| (rust !)
00b0: 42 64 61 74 61 2f 30 2e 69 00 03 00 01 00 00 00 |Bdata/0.i.......| (zstd no-rust !)
00b0: 65 72 65 76 6c 6f 67 25 32 43 73 74 6f 72 65 00 |erevlog%2Cstore.| (rust !)
00c0: 00 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 |................| (zstd no-rust !)
00c0: 00 80 00 73 08 42 64 61 74 61 2f 30 2e 69 00 03 |...s.Bdata/0.i..| (rust !)
00d0: 01 ff ff ff ff ff ff ff ff 80 29 63 a0 49 d3 23 |..........)c.I.#| (zstd no-rust !)
00d0: 00 01 00 00 00 00 00 00 00 02 00 00 00 01 00 00 |................| (rust !)
00e0: 87 bf ce fe 56 67 92 67 2c 69 d1 ec 39 00 00 00 |....Vg.g,i..9...| (zstd no-rust !)
00e0: 00 00 00 00 00 01 ff ff ff ff ff ff ff ff 80 29 |...............)| (rust !)
00f0: 00 00 00 00 00 00 00 00 00 75 30 73 08 42 64 61 |.........u0s.Bda| (zstd no-rust !)
00f0: 63 a0 49 d3 23 87 bf ce fe 56 67 92 67 2c 69 d1 |c.I.#....Vg.g,i.| (rust !)
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 --uncompressed is an alias to --stream
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 searching for changes
no changes found
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897
Clone with background file closing enabled
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 using http://localhost:$HGPORT/
sending capabilities command
sending branchmap command
streaming all changes
sending stream_out command
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 starting 4 threads for background file closing
Yuya Nishihara
transaction: remember original len(repo) instead of tracking added revs (API)...
r39337 updating the branch cache
revlog-compression: use zstd by default (if available)...
r47636 transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 query 1; heads
sending batch command
searching for changes
all remote heads known locally
no changes found
sending getbundle command
bundle2-input-bundle: with-transaction
bundle2-input-part: "listkeys" (params: 1 mandatory) supported
Boris Feld
pull: use 'phase-heads' to retrieve phase information...
r34323 bundle2-input-part: "phase-heads" supported
bundle2-input-part: total payload size 24
Martin von Zweigbergk
bundle2: fix an off-by-one in debug message of number of parts...
r43201 bundle2-input-bundle: 2 parts total
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 checking for updated bookmarks
clone: make sure we warm the cache after a clone...
r47032 updating the branch cache
Gregory Szorc
httppeer: report http statistics...
r40070 (sent 5 HTTP requests and * bytes; received * bytes in responses) (glob)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding
using http://localhost:$HGPORT/
sending capabilities command
query 1; heads
sending batch command
streaming all changes
sending getbundle command
bundle2-input-bundle: with-transaction
Gregory Szorc
bundle2: move version of stream clone into part name...
r35806 bundle2-input-part: "stream2" (params: 3 mandatory) supported
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 applying stream bundle
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
Boris Feld
streamclone: also stream caches to the client...
r35785 starting 4 threads for background file closing
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 starting 4 threads for background file closing
Yuya Nishihara
transaction: remember original len(repo) instead of tracking added revs (API)...
r39337 updating the branch cache
revlog-compression: use zstd by default (if available)...
r47636 transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
bundle2-input-part: total payload size 112094 (no-zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
bundle2-input-part: total payload size 109216 (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 bundle2-input-part: "listkeys" (params: 1 mandatory) supported
Martin von Zweigbergk
bundle2: fix an off-by-one in debug message of number of parts...
r43201 bundle2-input-bundle: 2 parts total
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 checking for updated bookmarks
clone: make sure we warm the cache after a clone...
r47032 updating the branch cache
Gregory Szorc
httppeer: report http statistics...
r40070 (sent 3 HTTP requests and * bytes; received * bytes in responses) (glob)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 Cannot stream clone when there are secret changesets
$ hg -R server phase --force --secret -r tip
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT secret-denied
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Streaming of secrets can be overridden by server config
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.uncompressedallowsecret=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT secret-allowed
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 searching for changes
no changes found
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream -U http://localhost:$HGPORT secret-allowed
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Verify interaction between preferuncompressed and secret presence
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.preferuncompressed=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
$ hg clone -U http://localhost:$HGPORT preferuncompressed-secret
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Clone not allowed when full bundles disabled and can't serve secrets
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.disablefullbundle=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream http://localhost:$HGPORT secret-full-disabled
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
remote: abort: server has pull-based clones disabled
abort: pull failed on remote
(remove --pull if specified or upgrade Mercurial)
Martin von Zweigbergk
errors: raise RemoteError in some places in exchange.py...
r47739 [100]
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
Local stream clone with secrets involved
(This is just a test over behavior: if you have access to the repo's files,
there is no security so it isn't important to prevent a clone here.)
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone -U --stream server local-secret
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517
Stream clone while repo is changing:
$ mkdir changing
$ cd changing
extension for delaying the server process so we reliably can modify the repo
while cloning
streamclone: remove sleep based "synchronisation" in tests...
r47748 $ cat > stream_steps.py <<EOF
> import os
> import sys
> from mercurial import (
> encoding,
> extensions,
> streamclone,
> testing,
> )
> WALKED_FILE_1 = encoding.environ[b'HG_TEST_STREAM_WALKED_FILE_1']
> WALKED_FILE_2 = encoding.environ[b'HG_TEST_STREAM_WALKED_FILE_2']
>
> def _test_sync_point_walk_1(orig, repo):
> testing.write_file(WALKED_FILE_1)
>
> def _test_sync_point_walk_2(orig, repo):
> assert repo._currentlock(repo._lockref) is None
> testing.wait_file(WALKED_FILE_2)
>
> extensions.wrapfunction(
> streamclone,
> '_test_sync_point_walk_1',
> _test_sync_point_walk_1
> )
> extensions.wrapfunction(
> streamclone,
> '_test_sync_point_walk_2',
> _test_sync_point_walk_2
> )
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 > EOF
prepare repo with small and big file to cover both code paths in emitrevlogdata
$ hg init repo
$ touch repo/f1
$ $TESTDIR/seq.py 50000 > repo/f2
$ hg -R repo ci -Aqm "0"
streamclone: remove sleep based "synchronisation" in tests...
r47748 $ HG_TEST_STREAM_WALKED_FILE_1="$TESTTMP/sync_file_walked_1"
$ export HG_TEST_STREAM_WALKED_FILE_1
$ HG_TEST_STREAM_WALKED_FILE_2="$TESTTMP/sync_file_walked_2"
$ export HG_TEST_STREAM_WALKED_FILE_2
$ HG_TEST_STREAM_WALKED_FILE_3="$TESTTMP/sync_file_walked_3"
$ export HG_TEST_STREAM_WALKED_FILE_3
# $ cat << EOF >> $HGRCPATH
# > [hooks]
# > pre-clone=rm -f "$TESTTMP/sync_file_walked_*"
# > EOF
$ hg serve -R repo -p $HGPORT1 -d --error errors.log --pid-file=hg.pid --config extensions.stream_steps="$RUNTESTDIR/testlib/ext-stream-clone-steps.py"
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ cat hg.pid >> $DAEMON_PIDS
clone while modifying the repo between stating file with write lock and
actually serving file content
streamclone: remove sleep based "synchronisation" in tests...
r47748 $ (hg clone -q --stream -U http://localhost:$HGPORT1 clone; touch "$HG_TEST_STREAM_WALKED_FILE_3") &
$ $RUNTESTDIR/testlib/wait-on-file 10 $HG_TEST_STREAM_WALKED_FILE_1
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ echo >> repo/f1
$ echo >> repo/f2
test-clone-uncompressed: use config to silence the lock warning...
r45636 $ hg -R repo ci -m "1" --config ui.timeout.warn=-1
streamclone: remove sleep based "synchronisation" in tests...
r47748 $ touch $HG_TEST_STREAM_WALKED_FILE_2
$ $RUNTESTDIR/testlib/wait-on-file 10 $HG_TEST_STREAM_WALKED_FILE_3
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ hg -R clone id
Mads Kiilerich
streamclone: fix error when store files grow while stream cloning...
r28518 000000000000
streamclone: remove sleep based "synchronisation" in tests...
r47748 $ cat errors.log
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ cd ..
Stream repository with bookmarks
--------------------------------
(revert introduction of secret changeset)
$ hg -R server phase --draft 'secret()'
add a bookmark
$ hg -R server bookmark -r tip some-bookmark
clone it
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ hg clone --stream http://localhost:$HGPORT with-bookmarks
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT with-bookmarks
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1033 files to transfer, 96.6 KB of data (no-zstd !)
transferred 96.6 KB in * seconds (* */sec) (glob) (no-zstd !)
1033 files to transfer, 93.8 KB of data (zstd !)
transferred 93.8 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ hg -R with-bookmarks bookmarks
some-bookmark 1:c17445101a72
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782
Stream repository with phases
-----------------------------
Clone as publishing
$ hg -R server phase -r 'all()'
0: draft
1: draft
#if stream-legacy
$ hg clone --stream http://localhost:$HGPORT phase-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT phase-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1033 files to transfer, 96.6 KB of data (no-zstd !)
transferred 96.6 KB in * seconds (* */sec) (glob) (no-zstd !)
1033 files to transfer, 93.8 KB of data (zstd !)
transferred 93.8 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
$ hg -R phase-publish phase -r 'all()'
0: public
1: public
Clone as non publishing
$ cat << EOF >> server/.hg/hgrc
> [phases]
> publish = False
> EOF
$ killdaemons.py
$ hg -R server serve -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ cat hg.pid > $DAEMON_PIDS
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782
#if stream-legacy
Boris Feld
streamclone: add a comment about non-publishing being broken with v1...
r35823
With v1 of the stream protocol, changeset are always cloned as public. It make
stream v1 unsuitable for non-publishing repository.
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 $ hg clone --stream http://localhost:$HGPORT phase-no-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (* */sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
$ hg -R phase-no-publish phase -r 'all()'
0: public
1: public
#endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT phase-no-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1034 files to transfer, 96.7 KB of data (no-zstd !)
transferred 96.7 KB in * seconds (* */sec) (glob) (no-zstd !)
1034 files to transfer, 93.9 KB of data (zstd !)
transferred 93.9 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
$ hg -R phase-no-publish phase -r 'all()'
Boris Feld
streamclone: add support for cloning non append-only file...
r35783 0: draft
1: draft
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 #endif
$ killdaemons.py
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434
#if stream-legacy
With v1 of the stream protocol, changeset are always cloned as public. There's
no obsolescence markers exchange in stream v1.
#endif
#if stream-bundle2
Stream repository with obsolescence
-----------------------------------
Clone non-publishing with obsolescence
$ cat >> $HGRCPATH << EOF
> [experimental]
> evolution=all
> EOF
$ cd server
$ echo foo > foo
$ hg -q commit -m 'about to be pruned'
$ hg debugobsolete `hg log -r . -T '{node}'` -d '0 0' -u test --record-parents
debugobsolete: also issue the "new obsmarkers" messsage...
r43163 1 new obsolescence markers
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 obsoleted 1 changesets
$ hg up null -q
$ hg log -T '{rev}: {phase}\n'
1: draft
0: draft
$ hg serve -p $HGPORT -d --pid-file=hg.pid
$ cat hg.pid > $DAEMON_PIDS
$ cd ..
$ hg clone -U --stream http://localhost:$HGPORT with-obsolescence
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1035 files to transfer, 97.1 KB of data (no-zstd !)
transferred 97.1 KB in * seconds (* */sec) (glob) (no-zstd !)
1035 files to transfer, 94.3 KB of data (zstd !)
transferred 94.3 KB in * seconds (* */sec) (glob) (zstd !)
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 $ hg -R with-obsolescence log -T '{rev}: {phase}\n'
1: draft
0: draft
$ hg debugobsolete -R with-obsolescence
50382b884f66690b7045cac93a540cba4d4c906f 0 {c17445101a72edac06facd130d14808dfbd5c7c2} (Thu Jan 01 00:00:00 1970 +0000) {'user': 'test'}
av6
streamclone: abort when client needs to handle obsmarkers, but doesn't...
r40435 $ hg clone -U --stream --config experimental.evolution=0 http://localhost:$HGPORT with-obsolescence-no-evolution
streaming all changes
remote: abort: server has obsolescence markers, but client cannot receive them via stream clone
abort: pull failed on remote
Martin von Zweigbergk
errors: raise RemoteError in some places in exchange.py...
r47739 [100]
av6
streamclone: abort when client needs to handle obsmarkers, but doesn't...
r40435
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 $ killdaemons.py
#endif