##// END OF EJS Templates
wireprotov2: define and implement "manifestdata" command...
wireprotov2: define and implement "manifestdata" command The added command can be used for obtaining manifest data. Given a manifest path and set of manifest nodes, data about manifests can be retrieved. Unlike changeset data, we wish to emit deltas to describe manifest revisions. So the command uses the relatively new API for building delta requests and emitting them. The code calls into deltaparent(), which I'm not very keen of. There's still work to be done in delta generation land so implementation details of storage (e.g. exactly one delta is stored/available) don't creep into higher levels. But we can worry about this later (there is already a TODO on imanifestorage tracking this). On the subject of parent deltas, the server assumes parent revisions exist on the receiving end. This is obviously wrong for shallow clone. I've added TODOs to add a mechanism to the command to allow clients to specify desired behavior. This shouldn't be too difficult to implement. Another big change is that the client must explicitly request manifest nodes to retrieve. This is a major departure from "getbundle," where the server derives relevant manifests as it iterates changesets and sends them automatically. As implemented, the client must transmit each requested node to the server. At 20 bytes per node, we're looking at 2 MB per 100,000 nodes. Plus wire encoding overhead. This isn't ideal for clients with limited upload bandwidth. I plan to address this in the future by allowing alternate mechanisms for defining the revisions to retrieve. One idea is to define a range of changeset revisions whose manifest revisions to retrieve (similar to how "changesetdata" works). We almost certainly want an API to look up an individual manifest by node. And that's where I've chosen to start with the implementation. Again, a theme of this early exchangev2 work is I want to start by building primitives for accessing raw repository data first and see how far we can get with those before we need more complexity. Differential Revision: https://phab.mercurial-scm.org/D4488

File last commit:

r36625:c6061cad default
r39673:c7a7c7e8 default
Show More
fakedirstatewritetime.py
78 lines | 2.5 KiB | text/x-python | PythonLexer
/ tests / fakedirstatewritetime.py
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 # extension to emulate invoking 'dirstate.write()' at the time
# specified by '[fakedirstatewritetime] fakenow', only when
# 'dirstate.write()' is invoked via functions below:
#
Siddharth Agarwal
workingctx: factor out post-status dirstate fixup...
r32812 # - 'workingctx._poststatusfixup()' (= 'repo.status()')
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 # - 'committablectx.markcommitted()'
Gregory Szorc
tests/fakedirstatewritetime.py: use absolute_import
r27283 from __future__ import absolute_import
from mercurial import (
context,
dirstate,
extensions,
Yuya Nishihara
parsers: switch to policy importer...
r32372 policy,
Boris Feld
configitems: register the test 'fakedirstatewritetime.fakenow' config
r34772 registrar,
Gregory Szorc
tests/fakedirstatewritetime.py: use absolute_import
r27283 )
Boris Feld
util: extract all date-related utils in utils/dateutil module...
r36625 from mercurial.utils import dateutil
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752
Boris Feld
configitems: register the test 'fakedirstatewritetime.fakenow' config
r34772 configtable = {}
configitem = registrar.configitem(configtable)
Pulkit Goyal
py3: add b'' prefixes in fakedirstatewritetime.py...
r36342 configitem(b'fakedirstatewritetime', b'fakenow',
Boris Feld
configitems: register the test 'fakedirstatewritetime.fakenow' config
r34772 default=None,
)
Yuya Nishihara
parsers: switch to policy importer...
r32372 parsers = policy.importmod(r'parsers')
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 def pack_dirstate(fakenow, orig, dmap, copymap, pl, now):
# execute what original parsers.pack_dirstate should do actually
# for consistency
actualnow = int(now)
Pulkit Goyal
py3: use dict.items() instead of dict.iteritems() in tests...
r36345 for f, e in dmap.items():
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 if e[0] == 'n' and e[3] == actualnow:
e = parsers.dirstatetuple(e[0], e[1], e[2], -1)
dmap[f] = e
return orig(dmap, copymap, pl, fakenow)
def fakewrite(ui, func):
# fake "now" of 'pack_dirstate' only if it is invoked while 'func'
Pulkit Goyal
py3: add b'' prefixes in fakedirstatewritetime.py...
r36342 fakenow = ui.config(b'fakedirstatewritetime', b'fakenow')
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 if not fakenow:
# Execute original one, if fakenow isn't configured. This is
# useful to prevent subrepos from executing replaced one,
# because replacing 'parsers.pack_dirstate' is also effective
# in subrepos.
return func()
# parsing 'fakenow' in YYYYmmddHHMM format makes comparison between
# 'fakenow' value and 'touch -t YYYYmmddHHMM' argument easy
Boris Feld
util: extract all date-related utils in utils/dateutil module...
r36625 fakenow = dateutil.parsedate(fakenow, [b'%Y%m%d%H%M'])[0]
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752
orig_pack_dirstate = parsers.pack_dirstate
FUJIWARA Katsunori
dirstate: make writing in-memory changes aware of transaction activity...
r26634 orig_dirstate_getfsnow = dirstate._getfsnow
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 wrapper = lambda *args: pack_dirstate(fakenow, orig_pack_dirstate, *args)
parsers.pack_dirstate = wrapper
FUJIWARA Katsunori
dirstate: make writing in-memory changes aware of transaction activity...
r26634 dirstate._getfsnow = lambda *args: fakenow
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 try:
return func()
finally:
parsers.pack_dirstate = orig_pack_dirstate
FUJIWARA Katsunori
dirstate: make writing in-memory changes aware of transaction activity...
r26634 dirstate._getfsnow = orig_dirstate_getfsnow
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752
Siddharth Agarwal
workingctx: also pass status tuple into poststatusfixup...
r32813 def _poststatusfixup(orig, workingctx, status, fixup):
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 ui = workingctx.repo().ui
Siddharth Agarwal
workingctx: also pass status tuple into poststatusfixup...
r32813 return fakewrite(ui, lambda : orig(workingctx, status, fixup))
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752
def markcommitted(orig, committablectx, node):
ui = committablectx.repo().ui
return fakewrite(ui, lambda : orig(committablectx, node))
def extsetup(ui):
Siddharth Agarwal
workingctx: factor out post-status dirstate fixup...
r32812 extensions.wrapfunction(context.workingctx, '_poststatusfixup',
_poststatusfixup)
FUJIWARA Katsunori
tests: add extension to emulate invoking dirstate.write at the specific time...
r25752 extensions.wrapfunction(context.committablectx, 'markcommitted',
markcommitted)