##// END OF EJS Templates
pyoxidizer: produce working Python 3 Windows installers (issue6366)...
pyoxidizer: produce working Python 3 Windows installers (issue6366) While we've had code to produce Python 3 Windows installers with PyOxidizer, we haven't been advertising them on the web site due to a bug in making TLS connections and issues around resource handling. This commit upgrades our PyOxidizer install and configuration to use a recent Git commit of PyOxidizer. This new version of PyOxidizer contains a *ton* of changes, improvements, and bug fixes. Notably, Windows shared distributions now mostly "just work" and the TLS bug and random problems with Python extension modules in the standard library go away. And Python has been upgraded from 3.7 to 3.8.6. The price we pay for this upgrade is a ton of backwards incompatible changes to Starlark. I applied this commit (the overall series actually) on stable to produce Windows installers for Mercurial 5.5.2, which I published shortly before submitting this commit for review. In order to get the stable branch working, I decided to take a less aggressive approach to Python resource management. Previously, we were attempting to load all Python modules from memory and were performing some hacks to copy Mercurial's non-module resources into additional directories in Starlark. This commit implements a resource callback function in Starlark (a new feature since PyOxidizer 0.7) to dynamically assign standard library resources to in-memory loading and all other resources to filesystem loading. This means that Mercurial's files and all the other packages we ship in the Windows installers (e.g. certifi and pygments) are loaded from the filesystem instead of from memory. This avoids issues due to lack of __file__ and enables us to ship a working Python 3 installer on Windows. The end state of the install layout after this patch is not ideal for @: we still copy resource files like templates and help text to directories next to the hg.exe executable. There is code in @ to use importlib.resources to load these files and we could likely remove these copies once this lands on @. But for now, the install layout mimics what we've shipped for seemingly forever and is backwards compatible. It allows us to achieve the milestone of working Python 3 Windows installers and gets us a giant step closer to deleting Python 2. Differential Revision: https://phab.mercurial-scm.org/D9148

File last commit:

r45985:0babbc33 default
r46277:57b5452a default
Show More
rewriteutil.py
125 lines | 3.9 KiB | text/x-python | PythonLexer
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 # rewriteutil.py - utility functions for rewriting changesets
#
# Copyright 2017 Octobus <contact@octobus.net>
#
# This software may be used and distributed according to the terms of the
# GNU General Public License version 2 or any later version.
from __future__ import absolute_import
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 import re
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 from .i18n import _
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 from . import (
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 error,
node,
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 obsolete,
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 obsutil,
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 revset,
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 scmutil,
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 )
Augie Fackler
style: run a patched black on a subset of mercurial...
r43345
Matt Harbison
rewriteutil: relax the sha1 hash references to handle future hash types...
r45996 NODE_RE = re.compile(br'\b[0-9a-f]{6,64}\b')
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 def precheck(repo, revs, action=b'rewrite'):
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 """check if revs can be rewritten
action is used to control the error message.
Make sure this function is called after taking the lock.
"""
if node.nullrev in revs:
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 msg = _(b"cannot %s null changeset") % action
hint = _(b"no changeset checked out")
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 raise error.Abort(msg, hint=hint)
if len(repo[None].parents()) > 1:
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 raise error.Abort(_(b"cannot %s while merging") % action)
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 publicrevs = repo.revs(b'%ld and public()', revs)
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 if publicrevs:
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 msg = _(b"cannot %s public changesets") % action
hint = _(b"see 'hg help phases' for details")
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243 raise error.Abort(msg, hint=hint)
newunstable = disallowednewunstable(repo, revs)
if newunstable:
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 raise error.Abort(_(b"cannot %s changeset with children") % action)
Pulkit Goyal
rewriteutil: add a precheck function to check if revs can be rewritten...
r35243
Augie Fackler
style: run a patched black on a subset of mercurial...
r43345
Pulkit Goyal
rewriteutil: add utility function to check if we can create new unstable cset...
r35242 def disallowednewunstable(repo, revs):
"""Checks whether editing the revs will create new unstable changesets and
are we allowed to create them.
To allow new unstable changesets, set the config:
`experimental.evolution.allowunstable=True`
"""
allowunstable = obsolete.isenabled(repo, obsolete.allowunstableopt)
if allowunstable:
return revset.baseset()
Augie Fackler
formatting: byteify all mercurial/ and hgext/ string literals...
r43347 return repo.revs(b"(%ld::) - %ld", revs, revs)
Manuel Jacob
rewriteutil: add utility to check whether empty successors should be skipped
r45682
def skip_empty_successor(ui, command):
empty_successor = ui.config(b'rewrite', b'empty-successor')
if empty_successor == b'skip':
return True
elif empty_successor == b'keep':
return False
else:
raise error.ConfigError(
_(
b"%s doesn't know how to handle config "
b"rewrite.empty-successor=%s (only 'skip' and 'keep' are "
b"supported)"
)
% (command, empty_successor)
)
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993
Matt Harbison
rewriteutil: also consider pending obsoletes when updating hashes in messages...
r45994 def update_hash_refs(repo, commitmsg, pending=None):
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 """Replace all obsolete commit hashes in the message with the current hash.
If the obsolete commit was split or is divergent, the hash is not replaced
as there's no way to know which successor to choose.
Matt Harbison
rewriteutil: also consider pending obsoletes when updating hashes in messages...
r45994
For commands that update a series of commits in the current transaction, the
new obsolete markers can be considered by setting ``pending`` to a mapping
of ``pending[oldnode] = [successor_node1, successor_node2,..]``.
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 """
Matt Harbison
rewriteutil: also consider pending obsoletes when updating hashes in messages...
r45994 if not pending:
pending = {}
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 cache = {}
Matt Harbison
rewriteutil: relax the sha1 hash references to handle future hash types...
r45996 hashes = re.findall(NODE_RE, commitmsg)
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 unfi = repo.unfiltered()
Matt Harbison
rewriteutil: relax the sha1 hash references to handle future hash types...
r45996 for h in hashes:
fullnode = scmutil.resolvehexnodeidprefix(unfi, h)
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 if fullnode is None:
continue
ctx = unfi[fullnode]
if not ctx.obsolete():
Matt Harbison
rewriteutil: also consider pending obsoletes when updating hashes in messages...
r45994 successors = pending.get(fullnode)
if successors is None:
continue
# obsutil.successorssets() returns a list of list of nodes
successors = [successors]
else:
successors = obsutil.successorssets(repo, ctx.node(), cache=cache)
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993
# We can't make any assumptions about how to update the hash if the
# cset in question was split or diverged.
if len(successors) == 1 and len(successors[0]) == 1:
Matt Harbison
rewriteutil: relax the sha1 hash references to handle future hash types...
r45996 newhash = node.hex(successors[0][0])
commitmsg = commitmsg.replace(h, newhash[: len(h)])
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 else:
repo.ui.note(
_(
b'The stale commit message reference to %s could '
b'not be updated\n'
)
Matt Harbison
rewriteutil: relax the sha1 hash references to handle future hash types...
r45996 % h
Matt Harbison
rewriteutil: extract evolve code used to replace obsolete hashes in commits...
r45993 )
return commitmsg