##// END OF EJS Templates
revlog: linearize created changegroups in generaldelta revlogs...
revlog: linearize created changegroups in generaldelta revlogs This greatly improves the speed of the bundling process, and often reduces the bundle size considerably. (Although if the repository is already ordered, this has little effect on both time and bundle size.) For non-generaldelta clients, the reduced bundle size translates to a reduced repository size, similar to shrinking the revlogs (which uses the exact same algorithm). For generaldelta clients the difference is minor. When the new bundle format comes, reordering will not be necessary since we can then store the deltaparent relationsships directly. The eventual default behavior for clients and servers is presented in the table below, where "new" implies support for GD as well as the new bundle format: old client new client old server old bundle, no reorder old bundle, no reorder new server, non-GD old bundle, no reorder[1] old bundle, no reorder[2] new server, GD old bundle, reorder[3] new bundle, no reorder[4] [1] reordering is expensive on the server in this case, skip it [2] client can choose to do its own redelta here [3] reordering is needed because otherwise the pull does a lot of extra work on the server [4] reordering isn't needed because client can get deltabase in bundle format Currently, the default is to reorder on GD-servers, and not otherwise. A new setting, bundle.reorder, has been added to override the default reordering behavior. It can be set to either 'auto' (the default), or any true or false value as a standard boolean setting, to either force the reordering on or off regardless of generaldelta. Some timing data from a relatively branch test repository follows. All bundling is done with --all --type none options. Non-generaldelta, non-shrunk repo: ----------------------------------- Size: 276M Without reorder (default): Bundle time: 14.4 seconds Bundle size: 939M With reorder: Bundle time: 1 minute, 29.3 seconds Bundle size: 381M Generaldelta, non-shrunk repo: ----------------------------------- Size: 87M Without reorder: Bundle time: 2 minutes, 1.4 seconds Bundle size: 939M With reorder (default): Bundle time: 25.5 seconds Bundle size: 381M

File last commit:

r14271:4030630f default
r14365:a8e3931e default
Show More
filemerge.py
269 lines | 9.2 KiB | text/x-python | PythonLexer
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 # filemerge.py - file-level merge handling for Mercurial
#
# Copyright 2006, 2007, 2008 Matt Mackall <mpm@selenic.com>
#
Martin Geisler
updated license to be explicit about GPL version 2
r8225 # This software may be used and distributed according to the terms of the
Matt Mackall
Update license to GPLv2+
r10263 # GNU General Public License version 2 or any later version.
Matt Mackall
filemerge: pull file-merging code into its own module
r6003
Peter Arrenbrecht
cleanup: drop unused imports
r7873 from node import short
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 from i18n import _
David Champion
merge: tool.premerge=keep will leave premerge markers in $local
r11146 import util, simplemerge, match, error
Simon Heimberg
separate import lines from mercurial and general python modules
r8312 import os, tempfile, re, filecmp
Matt Mackall
merge: allow smarter tool configuration...
r6004
Matt Mackall
filemerge: handle missing regappend
r6013 def _toolstr(ui, tool, part, default=""):
Matt Mackall
merge: allow smarter tool configuration...
r6004 return ui.config("merge-tools", tool + "." + part, default)
def _toolbool(ui, tool, part, default=False):
return ui.configbool("merge-tools", tool + "." + part, default)
David Champion
merge: introduce tool.check parameter...
r11148 def _toollist(ui, tool, part, default=[]):
return ui.configlist("merge-tools", tool + "." + part, default)
Matt Mackall
filemerge: add internal:dump...
r8831 _internal = ['internal:' + s
for s in 'fail local other merge prompt dump'.split()]
Matt Mackall
filemerge: add internal:prompt target
r8830
Matt Mackall
merge: allow smarter tool configuration...
r6004 def _findtool(ui, tool):
Matt Mackall
filemerge: add internal:prompt target
r8830 if tool in _internal:
Dov Feldstern
use internal merge tool when specified for a merge-pattern in hgrc...
r6522 return tool
Steve Borho
filemerge: introduce a 'regkeyalt' merge tool variable...
r13565 for kn in ("regkey", "regkeyalt"):
k = _toolstr(ui, tool, kn)
if not k:
continue
Adrian Buehlmann
rename util.lookup_reg to lookupreg
r14230 p = util.lookupreg(k, _toolstr(ui, tool, "regname"))
Matt Mackall
merge: add registry look up bits to tool search
r6006 if p:
Adrian Buehlmann
rename util.find_exe to findexe
r14271 p = util.findexe(p + _toolstr(ui, tool, "regappend"))
Matt Mackall
merge: add registry look up bits to tool search
r6006 if p:
return p
Adrian Buehlmann
rename util.find_exe to findexe
r14271 return util.findexe(_toolstr(ui, tool, "executable", tool))
Matt Mackall
merge: allow smarter tool configuration...
r6004
def _picktool(repo, ui, path, binary, symlink):
def check(tool, pat, symlink, binary):
tmsg = tool
if pat:
tmsg += " specified for " + pat
Mads Kiilerich
More verbose logging when filemerge searches for merge-tool...
r7397 if not _findtool(ui, tool):
if pat: # explicitly requested tool deserves a warning
ui.warn(_("couldn't find merge tool %s\n") % tmsg)
else: # configured but non-existing tools are more silent
ui.note(_("couldn't find merge tool %s\n") % tmsg)
Matt Mackall
merge: allow smarter tool configuration...
r6004 elif symlink and not _toolbool(ui, tool, "symlink"):
ui.warn(_("tool %s can't handle symlinks\n") % tmsg)
elif binary and not _toolbool(ui, tool, "binary"):
ui.warn(_("tool %s can't handle binary\n") % tmsg)
Matt Mackall
filemerge: add config item for GUI tools...
r6007 elif not util.gui() and _toolbool(ui, tool, "gui"):
ui.warn(_("tool %s requires a GUI\n") % tmsg)
Matt Mackall
merge: allow smarter tool configuration...
r6004 else:
return True
return False
Steve Borho
merge: implement --tool arguments using new ui.forcemerge configurable...
r12788 # forcemerge comes from command line arguments, highest priority
force = ui.config('ui', 'forcemerge')
if force:
toolpath = _findtool(ui, force)
if toolpath:
return (force, '"' + toolpath + '"')
else:
# mimic HGMERGE if given tool not found
return (force, force)
# HGMERGE takes next precedence
Steve Borho
filemerge: wrap quotes around tool path
r6025 hgmerge = os.environ.get("HGMERGE")
if hgmerge:
return (hgmerge, hgmerge)
Matt Mackall
merge: allow smarter tool configuration...
r6004
# then patterns
dhruva
filemerge: fix pattern matching
r6016 for pat, tool in ui.configitems("merge-patterns"):
Matt Mackall
match: add some default args
r8567 mf = match.match(repo.root, '', [pat])
Matt Mackall
merge: allow smarter tool configuration...
r6004 if mf(path) and check(tool, pat, symlink, False):
Benoit Boissinot
fix spaces/identation issues
r10339 toolpath = _findtool(ui, tool)
return (tool, '"' + toolpath + '"')
Matt Mackall
merge: allow smarter tool configuration...
r6004
# then merge tools
tools = {}
Matt Mackall
many, many trivial check-code fixups
r10282 for k, v in ui.configitems("merge-tools"):
Matt Mackall
merge: allow smarter tool configuration...
r6004 t = k.split('.')[0]
if t not in tools:
tools[t] = int(_toolstr(ui, t, "priority", "0"))
Steve Borho
filemerge: more backwards compatible behavior for ui.merge...
r6076 names = tools.keys()
Matt Mackall
many, many trivial check-code fixups
r10282 tools = sorted([(-p, t) for t, p in tools.items()])
Steve Borho
filemerge: more backwards compatible behavior for ui.merge...
r6076 uimerge = ui.config("ui", "merge")
if uimerge:
if uimerge not in names:
return (uimerge, uimerge)
tools.insert(0, (None, uimerge)) # highest priority
Matt Mackall
merge: allow smarter tool configuration...
r6004 tools.append((None, "hgmerge")) # the old default, if found
Matt Mackall
many, many trivial check-code fixups
r10282 for p, t in tools:
Mads Kiilerich
More verbose logging when filemerge searches for merge-tool...
r7397 if check(t, None, symlink, binary):
toolpath = _findtool(ui, t)
Steve Borho
filemerge: wrap quotes around tool path
r6025 return (t, '"' + toolpath + '"')
# internal merge as last resort
return (not (symlink or binary) and "internal:merge" or None, None)
Matt Mackall
filemerge: pull file-merging code into its own module
r6003
Matt Mackall
merge: add support for tool EOL fixups...
r6005 def _eoltype(data):
"Guess the EOL type of a file"
if '\0' in data: # binary
return None
if '\r\n' in data: # Windows
return '\r\n'
if '\r' in data: # Old Mac
return '\r'
if '\n' in data: # UNIX
return '\n'
return None # unknown
def _matcheol(file, origfile):
"Convert EOL markers in a file to match origfile"
Dan Villiom Podlaski Christiansen
prevent transient leaks of file handle by using new helper functions...
r14168 tostyle = _eoltype(util.readfile(origfile))
Matt Mackall
merge: add support for tool EOL fixups...
r6005 if tostyle:
Dan Villiom Podlaski Christiansen
prevent transient leaks of file handle by using new helper functions...
r14168 data = util.readfile(file)
Matt Mackall
merge: add support for tool EOL fixups...
r6005 style = _eoltype(data)
if style:
newdata = data.replace(style, tostyle)
if newdata != data:
Dan Villiom Podlaski Christiansen
prevent transient leaks of file handle by using new helper functions...
r14168 util.writefile(file, newdata)
Matt Mackall
merge: add support for tool EOL fixups...
r6005
Matt Mackall
merge: introduce mergestate
r6512 def filemerge(repo, mynode, orig, fcd, fco, fca):
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 """perform a 3-way merge in the working directory
Matt Mackall
merge: introduce mergestate
r6512 mynode = parent node before merge
orig = original local filename before merge
fco = other file context
fca = ancestor file context
fcd = local file context for current/destination file
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 """
def temp(prefix, ctx):
pre = "%s~%s." % (os.path.basename(ctx.path()), prefix)
(fd, name) = tempfile.mkstemp(prefix=pre)
data = repo.wwritedata(ctx.path(), ctx.data())
f = os.fdopen(fd, "wb")
f.write(data)
f.close()
return name
Matt Mackall
merge: allow smarter tool configuration...
r6004 def isbin(ctx):
try:
return util.binary(ctx.data())
except IOError:
return False
Nicolas Dumazet
filectx: use cmp(self, fctx) instead of cmp(self, text)...
r11702 if not fco.cmp(fcd): # files identical?
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 return None
Matt Mackall
merge: allow smarter tool configuration...
r6004 ui = repo.ui
Matt Mackall
merge: introduce mergestate
r6512 fd = fcd.path()
binary = isbin(fcd) or isbin(fco) or isbin(fca)
Matt Mackall
context: remove islink and isexec methods
r6744 symlink = 'l' in fcd.flags() + fco.flags()
Matt Mackall
merge: introduce mergestate
r6512 tool, toolpath = _picktool(repo, ui, fd, binary, symlink)
Martin Geisler
do not attempt to translate ui.debug output
r9467 ui.debug("picked tool '%s' for %s (binary %s symlink %s)\n" %
Matt Mackall
merge: introduce mergestate
r6512 (tool, fd, binary, symlink))
Matt Mackall
merge: allow smarter tool configuration...
r6004
Matt Mackall
filemerge: add internal:prompt target
r8830 if not tool or tool == 'internal:prompt':
Matt Mackall
merge: allow smarter tool configuration...
r6004 tool = "internal:local"
Simon Heimberg
ui: extract choice from prompt...
r9048 if ui.promptchoice(_(" no tool found to merge %s\n"
Martin Geisler
filemerge, subrepo: correct indention
r9049 "keep (l)ocal or take (o)ther?") % fd,
(_("&Local"), _("&Other")), 0):
Matt Mackall
merge: allow smarter tool configuration...
r6004 tool = "internal:other"
if tool == "internal:local":
return 0
if tool == "internal:other":
Matt Mackall
simplify flag handling...
r6743 repo.wwrite(fd, fco.data(), fco.flags())
Matt Mackall
merge: allow smarter tool configuration...
r6004 return 0
if tool == "internal:fail":
return 1
# do the actual merge
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 a = repo.wjoin(fd)
b = temp("base", fca)
c = temp("other", fco)
Matt Mackall
merge: allow smarter tool configuration...
r6004 out = ""
back = a + ".orig"
util.copyfile(a, back)
Matt Mackall
filemerge: pull file-merging code into its own module
r6003
Matt Mackall
merge: introduce mergestate
r6512 if orig != fco.path():
Martin Geisler
use ui instead of repo.ui when the former is in scope
r8615 ui.status(_("merging %s and %s to %s\n") % (orig, fco.path(), fd))
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 else:
Martin Geisler
use ui instead of repo.ui when the former is in scope
r8615 ui.status(_("merging %s\n") % fd)
Matt Mackall
merge: introduce mergestate
r6512
Martin Geisler
do not attempt to translate ui.debug output
r9467 ui.debug("my %s other %s ancestor %s\n" % (fcd, fco, fca))
Matt Mackall
filemerge: pull file-merging code into its own module
r6003
Matt Mackall
merge: allow smarter tool configuration...
r6004 # do we attempt to simplemerge first?
David Champion
merge: tool.premerge=keep will leave premerge markers in $local
r11146 try:
premerge = _toolbool(ui, tool, "premerge", not (binary or symlink))
except error.ConfigError:
premerge = _toolstr(ui, tool, "premerge").lower()
valid = 'keep'.split()
if premerge not in valid:
_valid = ', '.join(["'" + v + "'" for v in valid])
raise error.ConfigError(_("%s.premerge not valid "
"('%s' is neither boolean nor %s)") %
(tool, premerge, _valid))
if premerge:
Steve Borho
simplemerge: use ui.warn() for warnings
r8269 r = simplemerge.simplemerge(ui, a, b, c, quiet=True)
Matt Mackall
merge: allow smarter tool configuration...
r6004 if not r:
Martin Geisler
do not attempt to translate ui.debug output
r9467 ui.debug(" premerge successful\n")
Matt Mackall
merge: allow smarter tool configuration...
r6004 os.unlink(back)
os.unlink(b)
os.unlink(c)
return 0
David Champion
merge: tool.premerge=keep will leave premerge markers in $local
r11146 if premerge != 'keep':
util.copyfile(back, a) # restore from backup and try again
Matt Mackall
merge: allow smarter tool configuration...
r6004
env = dict(HG_FILE=fd,
Matt Mackall
merge: introduce mergestate
r6512 HG_MY_NODE=short(mynode),
HG_OTHER_NODE=str(fco.changectx()),
Sune Foldager
merge: supply base node to merge tools in the environment...
r9709 HG_BASE_NODE=str(fca.changectx()),
Matt Mackall
context: remove islink and isexec methods
r6744 HG_MY_ISLINK='l' in fcd.flags(),
HG_OTHER_ISLINK='l' in fco.flags(),
HG_BASE_ISLINK='l' in fca.flags())
Matt Mackall
merge: allow smarter tool configuration...
r6004
if tool == "internal:merge":
Steve Borho
simplemerge: use ui.warn() for warnings
r8269 r = simplemerge.simplemerge(ui, a, b, c, label=['local', 'other'])
Matt Mackall
filemerge: add internal:dump...
r8831 elif tool == 'internal:dump':
a = repo.wjoin(fd)
util.copyfile(a, a + ".local")
Matt Mackall
filemerge: fix internal:dump
r8861 repo.wwrite(fd + ".other", fco.data(), fco.flags())
repo.wwrite(fd + ".base", fca.data(), fca.flags())
Matt Mackall
filemerge: add internal:dump...
r8831 return 1 # unresolved
Matt Mackall
merge: allow smarter tool configuration...
r6004 else:
args = _toolstr(ui, tool, "args", '$local $base $other')
if "$output" in args:
out, a = a, back # read input from backup, write to original
replace = dict(local=a, base=b, other=c, output=out)
Steve Losh
util: add an interpolate() function to for replacing multiple values...
r11988 args = util.interpolate(r'\$', replace, args,
lambda s: '"%s"' % util.localpath(s))
Matt Mackall
merge: allow smarter tool configuration...
r6004 r = util.system(toolpath + ' ' + args, cwd=repo.root, environ=env)
David Champion
merge: introduce tool.check parameter...
r11148 if not r and (_toolbool(ui, tool, "checkconflicts") or
'conflicts' in _toollist(ui, tool, "check")):
Thomas Arendsen Hein
Fix merge-tools.checkconflicts...
r12046 if re.search("^(<<<<<<< .*|=======|>>>>>>> .*)$", fcd.data(),
re.MULTILINE):
Matt Mackall
merge: allow smarter tool configuration...
r6004 r = 1
David Champion
merge: tool.check = prompt will force an interactive merge check...
r11149 checked = False
if 'prompt' in _toollist(ui, tool, "check"):
checked = True
if ui.promptchoice(_("was merge of '%s' successful (yn)?") % fd,
(_("&Yes"), _("&No")), 1):
r = 1
if not r and not checked and (_toolbool(ui, tool, "checkchanged") or
'changed' in _toollist(ui, tool, "check")):
Steve Borho
filemerge: add 'checkchanged' merge tool property
r6075 if filecmp.cmp(repo.wjoin(fd), back):
Simon Heimberg
ui: extract choice from prompt...
r9048 if ui.promptchoice(_(" output file %s appears unchanged\n"
Martin Geisler
filemerge, subrepo: correct indention
r9049 "was merge successful (yn)?") % fd,
(_("&Yes"), _("&No")), 1):
Steve Borho
filemerge: add 'checkchanged' merge tool property
r6075 r = 1
Matt Mackall
merge: add support for tool EOL fixups...
r6005 if _toolbool(ui, tool, "fixeol"):
Lee Cantey
filemerge: fix path to working file when fixeol is enabled
r6015 _matcheol(repo.wjoin(fd), back)
Matt Mackall
merge: add support for tool EOL fixups...
r6005
Matt Mackall
filemerge: pull file-merging code into its own module
r6003 if r:
Martin Geisler
use ui instead of repo.ui when the former is in scope
r8615 ui.warn(_("merging %s failed!\n") % fd)
Matt Mackall
merge: allow smarter tool configuration...
r6004 else:
os.unlink(back)
Matt Mackall
filemerge: pull file-merging code into its own module
r6003
os.unlink(b)
os.unlink(c)
return r