##// END OF EJS Templates
mail: use a context manager when writing to mbox...
mail: use a context manager when writing to mbox Differential Revision: https://phab.mercurial-scm.org/D10484

File last commit:

r47739:3f87d2af default
r47744:d467bae8 default
Show More
test-clone-uncompressed.t
636 lines | 22.4 KiB | text/troff | Tads3Lexer
/ tests / test-clone-uncompressed.t
Kyle Lippincott
tests: mark tests that fail when using chg as #require no-chg...
r38041 #require serve no-reposimplestore no-chg
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #testcases stream-legacy stream-bundle2
av6
bundle2: make server.bundle2.stream default to True...
r39758 #if stream-legacy
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 $ cat << EOF >> $HGRCPATH
av6
bundle2: graduate bundle2.stream option from experimental to server section...
r39757 > [server]
av6
bundle2: make server.bundle2.stream default to True...
r39758 > bundle2.stream = no
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 > EOF
#endif
timeless
bdiff: (pure) support array.array arrays (issue5130)
r28389 Initialize repository
the status call is to check for issue5130
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ hg init server
$ cd server
$ touch foo
$ hg -q commit -A -m initial
>>> for i in range(1024):
... with open(str(i), 'wb') as fh:
Pulkit Goyal
py3: use b"%d" instead of str() to convert int to bytes...
r37685 ... fh.write(b"%d" % i) and None
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ hg -q commit -A -m 'add a lot of files'
timeless
bdiff: (pure) support array.array arrays (issue5130)
r28389 $ hg st
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ hg --config server.uncompressed=false serve -p $HGPORT -d --pid-file=hg.pid
$ cat hg.pid > $DAEMON_PIDS
$ cd ..
Cannot stream clone when server.uncompressed is set
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=stream_out'
200 Script output follows
1
#if stream-legacy
$ hg debugcapabilities http://localhost:$HGPORT
Main capabilities:
batch
branchmap
Gregory Szorc
bundle2: always advertise client support for stream parts...
r35810 $USUAL_BUNDLE2_CAPS_SERVER$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 changegroupsubset
Augie Fackler
tests: add a pattern to fix --pure tests...
r35824 compression=$BUNDLE2_COMPRESSIONS$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 getbundle
httpheader=1024
httpmediatype=0.1rx,0.1tx,0.2tx
known
lookup
pushkey
unbundle=HG10GZ,HG10BZ,HG10UN
unbundlehash
Bundle2 capabilities:
HG20
bookmarks
changegroup
01
02
Valentin Gatien-Baron
exchange: turn on option that makes concurrent pushes work better...
r44896 checkheads
related
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 digests
md5
sha1
sha512
error
abort
unsupportedcontent
pushraced
pushkey
hgtagsfnodes
listkeys
phases
heads
pushkey
remote-changegroup
http
https
$ hg clone --stream -U http://localhost:$HGPORT server-disabled
warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 2 changesets with 1025 changes to 1025 files
new changesets 96ee1d7354c4:c17445101a72
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto 0.2 --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size body --hexdump --bytes 100
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 body: size=232
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 0010: cf 0b 45 52 52 4f 52 3a 41 42 4f 52 54 00 00 00 |..ERROR:ABORT...|
0020: 00 01 01 07 3c 04 72 6d 65 73 73 61 67 65 73 74 |....<.rmessagest|
0030: 72 65 61 6d 20 64 61 74 61 20 72 65 71 75 65 73 |ream data reques|
0040: 74 65 64 20 62 75 74 20 73 65 72 76 65 72 20 64 |ted but server d|
0050: 6f 65 73 20 6e 6f 74 20 61 6c 6c 6f 77 20 74 68 |oes not allow th|
0060: 69 73 20 66 |is f|
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807
#endif
#if stream-bundle2
$ hg debugcapabilities http://localhost:$HGPORT
Main capabilities:
batch
branchmap
Gregory Szorc
bundle2: always advertise client support for stream parts...
r35810 $USUAL_BUNDLE2_CAPS_SERVER$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 changegroupsubset
Augie Fackler
tests: add a pattern to fix --pure tests...
r35824 compression=$BUNDLE2_COMPRESSIONS$
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 getbundle
httpheader=1024
httpmediatype=0.1rx,0.1tx,0.2tx
known
lookup
pushkey
unbundle=HG10GZ,HG10BZ,HG10UN
unbundlehash
Bundle2 capabilities:
HG20
bookmarks
changegroup
01
02
Valentin Gatien-Baron
exchange: turn on option that makes concurrent pushes work better...
r44896 checkheads
related
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 digests
md5
sha1
sha512
error
abort
unsupportedcontent
pushraced
pushkey
hgtagsfnodes
listkeys
phases
heads
pushkey
remote-changegroup
http
https
$ hg clone --stream -U http://localhost:$HGPORT server-disabled
warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 2 changesets with 1025 changes to 1025 files
new changesets 96ee1d7354c4:c17445101a72
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto 0.2 --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size body --hexdump --bytes 100
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 body: size=232
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
Gregory Szorc
exchange: don't send stream data when server.uncompressed is set...
r35809 0010: cf 0b 45 52 52 4f 52 3a 41 42 4f 52 54 00 00 00 |..ERROR:ABORT...|
0020: 00 01 01 07 3c 04 72 6d 65 73 73 61 67 65 73 74 |....<.rmessagest|
0030: 72 65 61 6d 20 64 61 74 61 20 72 65 71 75 65 73 |ream data reques|
0040: 74 65 64 20 62 75 74 20 73 65 72 76 65 72 20 64 |ted but server d|
0050: 6f 65 73 20 6e 6f 74 20 61 6c 6c 6f 77 20 74 68 |oes not allow th|
0060: 69 73 20 66 |is f|
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807
#endif
$ killdaemons.py
$ cd server
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ hg serve -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ cat hg.pid > $DAEMON_PIDS
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 $ cd ..
Basic clone
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT clone1
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 searching for changes
no changes found
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream -U http://localhost:$HGPORT clone1
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (*/sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: also stream caches to the client...
r35785
$ ls -1 clone1/.hg/cache
clone: make sure we warm the cache after a clone...
r47032 branch2-base
branch2-immutable
Boris Feld
streamclone: also stream caches to the client...
r35785 branch2-served
clone: make sure we warm the cache after a clone...
r47032 branch2-served.hidden
branch2-visible
branch2-visible-hidden
hgtagsfnodes1
Boris Feld
streamclone: also stream caches to the client...
r35785 rbc-names-v1
rbc-revs-v1
clone: make sure we warm the cache after a clone...
r47032 tags2
tags2-served
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805 getbundle requests with stream=1 are uncompressed
$ get-with-headers.py $LOCALIP:$HGPORT '?cmd=getbundle' content-type --bodyfile body --hgproto '0.1 0.2 comp=zlib,none' --requestheader "x-hgarg-1=bundlecaps=HG20%2Cbundle2%3DHG20%250Abookmarks%250Achangegroup%253D01%252C02%250Adigests%253Dmd5%252Csha1%252Csha512%250Aerror%253Dabort%252Cunsupportedcontent%252Cpushraced%252Cpushkey%250Ahgtagsfnodes%250Alistkeys%250Aphases%253Dheads%250Apushkey%250Aremote-changegroup%253Dhttp%252Chttps&cg=0&common=0000000000000000000000000000000000000000&heads=c17445101a72edac06facd130d14808dfbd5c7c2&stream=1"
200 Script output follows
content-type: application/mercurial-0.2
$ f --size --hex --bytes 256 body
revlog-compression: use zstd by default (if available)...
r47636 body: size=112262 (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 body: size=109410 (zstd no-rust !)
body: size=109431 (rust !)
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805 0000: 04 6e 6f 6e 65 48 47 32 30 00 00 00 00 00 00 00 |.noneHG20.......|
revlog-compression: use zstd by default (if available)...
r47636 0010: 7f 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (no-zstd !)
0020: 05 09 04 0c 44 62 79 74 65 63 6f 75 6e 74 39 38 |....Dbytecount98| (no-zstd !)
0030: 37 37 35 66 69 6c 65 63 6f 75 6e 74 31 30 33 30 |775filecount1030| (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 0010: 99 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (zstd no-rust !)
0010: ae 07 53 54 52 45 41 4d 32 00 00 00 00 03 00 09 |..STREAM2.......| (rust !)
0020: 05 09 04 0c 5e 62 79 74 65 63 6f 75 6e 74 39 35 |....^bytecount95| (zstd no-rust !)
0020: 05 09 04 0c 73 62 79 74 65 63 6f 75 6e 74 39 35 |....sbytecount95| (rust !)
revlog-compression: use zstd by default (if available)...
r47636 0030: 38 39 37 66 69 6c 65 63 6f 75 6e 74 31 30 33 30 |897filecount1030| (zstd !)
Gregory Szorc
bundle2: move version of stream clone into part name...
r35806 0040: 72 65 71 75 69 72 65 6d 65 6e 74 73 64 6f 74 65 |requirementsdote|
Boris Feld
bundle2: fix the formatting of the stream part requirements...
r35831 0050: 6e 63 6f 64 65 25 32 43 66 6e 63 61 63 68 65 25 |ncode%2Cfncache%|
0060: 32 43 67 65 6e 65 72 61 6c 64 65 6c 74 61 25 32 |2Cgeneraldelta%2|
revlog-compression: use zstd by default (if available)...
r47636 0070: 43 72 65 76 6c 6f 67 76 31 25 32 43 73 70 61 72 |Crevlogv1%2Cspar| (no-zstd !)
0080: 73 65 72 65 76 6c 6f 67 25 32 43 73 74 6f 72 65 |serevlog%2Cstore| (no-zstd !)
0090: 00 00 80 00 73 08 42 64 61 74 61 2f 30 2e 69 00 |....s.Bdata/0.i.| (no-zstd !)
00a0: 03 00 01 00 00 00 00 00 00 00 02 00 00 00 01 00 |................| (no-zstd !)
00b0: 00 00 00 00 00 00 01 ff ff ff ff ff ff ff ff 80 |................| (no-zstd !)
00c0: 29 63 a0 49 d3 23 87 bf ce fe 56 67 92 67 2c 69 |)c.I.#....Vg.g,i| (no-zstd !)
00d0: d1 ec 39 00 00 00 00 00 00 00 00 00 00 00 00 75 |..9............u| (no-zstd !)
00e0: 30 73 08 42 64 61 74 61 2f 31 2e 69 00 03 00 01 |0s.Bdata/1.i....| (no-zstd !)
00f0: 00 00 00 00 00 00 00 02 00 00 00 01 00 00 00 00 |................| (no-zstd !)
persistent-nodemap: enable the feature by default when using Rust...
r47646 0070: 43 72 65 76 6c 6f 67 2d 63 6f 6d 70 72 65 73 73 |Crevlog-compress| (zstd no-rust !)
0070: 43 70 65 72 73 69 73 74 65 6e 74 2d 6e 6f 64 65 |Cpersistent-node| (rust !)
0080: 69 6f 6e 2d 7a 73 74 64 25 32 43 72 65 76 6c 6f |ion-zstd%2Crevlo| (zstd no-rust !)
0080: 6d 61 70 25 32 43 72 65 76 6c 6f 67 2d 63 6f 6d |map%2Crevlog-com| (rust !)
0090: 67 76 31 25 32 43 73 70 61 72 73 65 72 65 76 6c |gv1%2Csparserevl| (zstd no-rust !)
0090: 70 72 65 73 73 69 6f 6e 2d 7a 73 74 64 25 32 43 |pression-zstd%2C| (rust !)
00a0: 6f 67 25 32 43 73 74 6f 72 65 00 00 80 00 73 08 |og%2Cstore....s.| (zstd no-rust !)
00a0: 72 65 76 6c 6f 67 76 31 25 32 43 73 70 61 72 73 |revlogv1%2Cspars| (rust !)
00b0: 42 64 61 74 61 2f 30 2e 69 00 03 00 01 00 00 00 |Bdata/0.i.......| (zstd no-rust !)
00b0: 65 72 65 76 6c 6f 67 25 32 43 73 74 6f 72 65 00 |erevlog%2Cstore.| (rust !)
00c0: 00 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 |................| (zstd no-rust !)
00c0: 00 80 00 73 08 42 64 61 74 61 2f 30 2e 69 00 03 |...s.Bdata/0.i..| (rust !)
00d0: 01 ff ff ff ff ff ff ff ff 80 29 63 a0 49 d3 23 |..........)c.I.#| (zstd no-rust !)
00d0: 00 01 00 00 00 00 00 00 00 02 00 00 00 01 00 00 |................| (rust !)
00e0: 87 bf ce fe 56 67 92 67 2c 69 d1 ec 39 00 00 00 |....Vg.g,i..9...| (zstd no-rust !)
00e0: 00 00 00 00 00 01 ff ff ff ff ff ff ff ff 80 29 |...............)| (rust !)
00f0: 00 00 00 00 00 00 00 00 00 75 30 73 08 42 64 61 |.........u0s.Bda| (zstd no-rust !)
00f0: 63 a0 49 d3 23 87 bf ce fe 56 67 92 67 2c 69 d1 |c.I.#....Vg.g,i.| (rust !)
Gregory Szorc
exchange: send bundle2 stream clones uncompressed...
r35805
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 --uncompressed is an alias to --stream
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 searching for changes
no changes found
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897
Clone with background file closing enabled
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 using http://localhost:$HGPORT/
sending capabilities command
sending branchmap command
streaming all changes
sending stream_out command
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 starting 4 threads for background file closing
Yuya Nishihara
transaction: remember original len(repo) instead of tracking added revs (API)...
r39337 updating the branch cache
revlog-compression: use zstd by default (if available)...
r47636 transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 query 1; heads
sending batch command
searching for changes
all remote heads known locally
no changes found
sending getbundle command
bundle2-input-bundle: with-transaction
bundle2-input-part: "listkeys" (params: 1 mandatory) supported
Boris Feld
pull: use 'phase-heads' to retrieve phase information...
r34323 bundle2-input-part: "phase-heads" supported
bundle2-input-part: total payload size 24
Martin von Zweigbergk
bundle2: fix an off-by-one in debug message of number of parts...
r43201 bundle2-input-bundle: 2 parts total
Gregory Szorc
streamclone: use backgroundfilecloser (issue4889)...
r27897 checking for updated bookmarks
clone: make sure we warm the cache after a clone...
r47032 updating the branch cache
Gregory Szorc
httppeer: report http statistics...
r40070 (sent 5 HTTP requests and * bytes; received * bytes in responses) (glob)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding
using http://localhost:$HGPORT/
sending capabilities command
query 1; heads
sending batch command
streaming all changes
sending getbundle command
bundle2-input-bundle: with-transaction
Gregory Szorc
bundle2: move version of stream clone into part name...
r35806 bundle2-input-part: "stream2" (params: 3 mandatory) supported
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 applying stream bundle
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
Boris Feld
streamclone: also stream caches to the client...
r35785 starting 4 threads for background file closing
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 starting 4 threads for background file closing
Yuya Nishihara
transaction: remember original len(repo) instead of tracking added revs (API)...
r39337 updating the branch cache
revlog-compression: use zstd by default (if available)...
r47636 transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
bundle2-input-part: total payload size 112094 (no-zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
bundle2-input-part: total payload size 109216 (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 bundle2-input-part: "listkeys" (params: 1 mandatory) supported
Martin von Zweigbergk
bundle2: fix an off-by-one in debug message of number of parts...
r43201 bundle2-input-bundle: 2 parts total
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 checking for updated bookmarks
clone: make sure we warm the cache after a clone...
r47032 updating the branch cache
Gregory Szorc
httppeer: report http statistics...
r40070 (sent 3 HTTP requests and * bytes; received * bytes in responses) (glob)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 Cannot stream clone when there are secret changesets
$ hg -R server phase --force --secret -r tip
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT secret-denied
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Streaming of secrets can be overridden by server config
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.uncompressedallowsecret=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream -U http://localhost:$HGPORT secret-allowed
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*/sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 searching for changes
no changes found
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream -U http://localhost:$HGPORT secret-allowed
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1030 files to transfer, 96.5 KB of data (no-zstd !)
transferred 96.5 KB in * seconds (* */sec) (glob) (no-zstd !)
1030 files to transfer, 93.6 KB of data (zstd !)
transferred 93.6 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Verify interaction between preferuncompressed and secret presence
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.preferuncompressed=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
$ hg clone -U http://localhost:$HGPORT preferuncompressed-secret
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
$ killdaemons.py
Clone not allowed when full bundles disabled and can't serve secrets
$ cd server
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve --config server.disablefullbundle=true -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 $ cat hg.pid > $DAEMON_PIDS
$ cd ..
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone --stream http://localhost:$HGPORT secret-full-disabled
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
remote: abort: server has pull-based clones disabled
abort: pull failed on remote
(remove --pull if specified or upgrade Mercurial)
Martin von Zweigbergk
errors: raise RemoteError in some places in exchange.py...
r47739 [100]
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744
Local stream clone with secrets involved
(This is just a test over behavior: if you have access to the repo's files,
there is no security so it isn't important to prevent a clone here.)
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone -U --stream server local-secret
Gregory Szorc
streamclone: consider secret changesets (BC) (issue5589)...
r32744 warning: stream clone requested but server has them disabled
requesting all changes
adding changesets
adding manifests
adding file changes
added 1 changesets with 1 changes to 1 files
Denis Laxalde
transaction-summary: show the range of new revisions upon pull/unbundle (BC)...
r34662 new changesets 96ee1d7354c4
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517
Stream clone while repo is changing:
$ mkdir changing
$ cd changing
extension for delaying the server process so we reliably can modify the repo
while cloning
$ cat > delayer.py <<EOF
> import time
Pierre-Yves David
vfs: use 'vfs' module directly in 'test-clone-uncompressed'...
r31252 > from mercurial import extensions, vfs
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 > def __call__(orig, self, path, *args, **kwargs):
> if path == 'data/f1.i':
> time.sleep(2)
> return orig(self, path, *args, **kwargs)
Pierre-Yves David
vfs: use 'vfs' module directly in 'test-clone-uncompressed'...
r31252 > extensions.wrapfunction(vfs.vfs, '__call__', __call__)
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 > EOF
prepare repo with small and big file to cover both code paths in emitrevlogdata
$ hg init repo
$ touch repo/f1
$ $TESTDIR/seq.py 50000 > repo/f2
$ hg -R repo ci -Aqm "0"
Saurabh Singh
serve: make tests compatible with chg...
r34484 $ hg serve -R repo -p $HGPORT1 -d --pid-file=hg.pid --config extensions.delayer=delayer.py
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ cat hg.pid >> $DAEMON_PIDS
clone while modifying the repo between stating file with write lock and
actually serving file content
Gregory Szorc
commands: rename clone --uncompressed to --stream and document...
r34394 $ hg clone -q --stream -U http://localhost:$HGPORT1 clone &
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ sleep 1
$ echo >> repo/f1
$ echo >> repo/f2
test-clone-uncompressed: use config to silence the lock warning...
r45636 $ hg -R repo ci -m "1" --config ui.timeout.warn=-1
Mads Kiilerich
tests: add test of stream clone of repo that is changing...
r28517 $ wait
$ hg -R clone id
Mads Kiilerich
streamclone: fix error when store files grow while stream cloning...
r28518 000000000000
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ cd ..
Stream repository with bookmarks
--------------------------------
(revert introduction of secret changeset)
$ hg -R server phase --draft 'secret()'
add a bookmark
$ hg -R server bookmark -r tip some-bookmark
clone it
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #if stream-legacy
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ hg clone --stream http://localhost:$HGPORT with-bookmarks
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 #endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT with-bookmarks
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1033 files to transfer, 96.6 KB of data (no-zstd !)
transferred 96.6 KB in * seconds (* */sec) (glob) (no-zstd !)
1033 files to transfer, 93.8 KB of data (zstd !)
transferred 93.8 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: add support for bundle2 based stream clone...
r35781 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
Boris Feld
stream: add a test showing we also clone bookmarks...
r35765 $ hg -R with-bookmarks bookmarks
some-bookmark 1:c17445101a72
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782
Stream repository with phases
-----------------------------
Clone as publishing
$ hg -R server phase -r 'all()'
0: draft
1: draft
#if stream-legacy
$ hg clone --stream http://localhost:$HGPORT phase-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (*) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT phase-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1033 files to transfer, 96.6 KB of data (no-zstd !)
transferred 96.6 KB in * seconds (* */sec) (glob) (no-zstd !)
1033 files to transfer, 93.8 KB of data (zstd !)
transferred 93.8 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
#endif
$ hg -R phase-publish phase -r 'all()'
0: public
1: public
Clone as non publishing
$ cat << EOF >> server/.hg/hgrc
> [phases]
> publish = False
> EOF
$ killdaemons.py
$ hg -R server serve -p $HGPORT -d --pid-file=hg.pid
Gregory Szorc
tests: add more testing around server.uncompressed...
r35807 $ cat hg.pid > $DAEMON_PIDS
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782
#if stream-legacy
Boris Feld
streamclone: add a comment about non-publishing being broken with v1...
r35823
With v1 of the stream protocol, changeset are always cloned as public. It make
stream v1 unsuitable for non-publishing repository.
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 $ hg clone --stream http://localhost:$HGPORT phase-no-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1027 files to transfer, 96.3 KB of data (no-zstd !)
transferred 96.3 KB in * seconds (* */sec) (glob) (no-zstd !)
1027 files to transfer, 93.5 KB of data (zstd !)
transferred 93.5 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 searching for changes
no changes found
updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
$ hg -R phase-no-publish phase -r 'all()'
0: public
1: public
#endif
#if stream-bundle2
$ hg clone --stream http://localhost:$HGPORT phase-no-publish
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1034 files to transfer, 96.7 KB of data (no-zstd !)
transferred 96.7 KB in * seconds (* */sec) (glob) (no-zstd !)
1034 files to transfer, 93.9 KB of data (zstd !)
transferred 93.9 KB in * seconds (* */sec) (glob) (zstd !)
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 updating to branch default
1025 files updated, 0 files merged, 0 files removed, 0 files unresolved
$ hg -R phase-no-publish phase -r 'all()'
Boris Feld
streamclone: add support for cloning non append-only file...
r35783 0: draft
1: draft
Boris Feld
streamclone: tests phase exchange during stream clone...
r35782 #endif
$ killdaemons.py
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434
#if stream-legacy
With v1 of the stream protocol, changeset are always cloned as public. There's
no obsolescence markers exchange in stream v1.
#endif
#if stream-bundle2
Stream repository with obsolescence
-----------------------------------
Clone non-publishing with obsolescence
$ cat >> $HGRCPATH << EOF
> [experimental]
> evolution=all
> EOF
$ cd server
$ echo foo > foo
$ hg -q commit -m 'about to be pruned'
$ hg debugobsolete `hg log -r . -T '{node}'` -d '0 0' -u test --record-parents
debugobsolete: also issue the "new obsmarkers" messsage...
r43163 1 new obsolescence markers
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 obsoleted 1 changesets
$ hg up null -q
$ hg log -T '{rev}: {phase}\n'
1: draft
0: draft
$ hg serve -p $HGPORT -d --pid-file=hg.pid
$ cat hg.pid > $DAEMON_PIDS
$ cd ..
$ hg clone -U --stream http://localhost:$HGPORT with-obsolescence
streaming all changes
revlog-compression: use zstd by default (if available)...
r47636 1035 files to transfer, 97.1 KB of data (no-zstd !)
transferred 97.1 KB in * seconds (* */sec) (glob) (no-zstd !)
1035 files to transfer, 94.3 KB of data (zstd !)
transferred 94.3 KB in * seconds (* */sec) (glob) (zstd !)
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 $ hg -R with-obsolescence log -T '{rev}: {phase}\n'
1: draft
0: draft
$ hg debugobsolete -R with-obsolescence
50382b884f66690b7045cac93a540cba4d4c906f 0 {c17445101a72edac06facd130d14808dfbd5c7c2} (Thu Jan 01 00:00:00 1970 +0000) {'user': 'test'}
av6
streamclone: abort when client needs to handle obsmarkers, but doesn't...
r40435 $ hg clone -U --stream --config experimental.evolution=0 http://localhost:$HGPORT with-obsolescence-no-evolution
streaming all changes
remote: abort: server has obsolescence markers, but client cannot receive them via stream clone
abort: pull failed on remote
Martin von Zweigbergk
errors: raise RemoteError in some places in exchange.py...
r47739 [100]
av6
streamclone: abort when client needs to handle obsmarkers, but doesn't...
r40435
av6
streamclone: include obsstore file into stream bundle if client can read it
r40434 $ killdaemons.py
#endif