upstream/mercurial-mirror Files · contrib/packaging/build-linux-wheels.sh

remotefilelog: replace repack lock to solve race condition...

remotefilelog: replace repack lock to solve race condition reduced the probability of race-conditions when starting background repack and prefetch and we saw the difference in our CI instance with all failures disappearing except one where one call to waitonrepack seems to returns too early. I'm not sure what exactly goes wrong but I realized that while the prefetch operation uses a standard Mercurial lock, the repack operation is using a custom lock based on `fcntl.flock` on available platforms. As `extutil.flock` fallback on traditional Mercurial locks on other platforms and the tests are stable on my laptop, our CI environment and GCC112, I'm sending this patch to standardize the behavior across environments. Differential Revision: https://phab.mercurial-scm.org/D6844

Gregory Szorc - - Load All Authors

File last commit:

r38031:6f5b4cee default


                r43213:5fadf610

default

Download file

             build-linux-wheels.sh
        
                    34 lines
            
             | 1.1 KiB
            
                | application/x-sh
            
             |
                BashLexer
            
             / contrib / packaging / build-linux-wheels.sh
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #!/bin/bash

      # This file is directly inspired by

      # https://github.com/pypa/python-manylinux-demo/blob/master/travis/build-wheels.sh

      set -e -x

      PYTHON_TARGETS=$(ls -d /opt/python/cp27*/bin)

      # Create an user for the tests

      useradd hgbuilder

      # Bypass uid/gid problems

      cp -R /src /io && chown -R hgbuilder:hgbuilder /io

      # Compile wheels for Python 2.X

      for PYBIN in $PYTHON_TARGETS; do

          "${PYBIN}/pip" wheel /io/ -w wheelhouse/

      done

      # Bundle external shared libraries into the wheels with

      # auditwheel (https://github.com/pypa/auditwheel) repair.

      # It also fix the ABI tag on the wheel making it pip installable.

      for whl in wheelhouse/*.whl; do

          auditwheel repair "$whl" -w /src/wheelhouse/

      done

      # Install packages and run the tests for all Python versions

      cd /io/tests/

      for PYBIN in $PYTHON_TARGETS; do

          # Install mercurial wheel as root

          "${PYBIN}/pip" install mercurial --no-index -f /src/wheelhouse

          # But run tests as hgbuilder user (non-root)

          su hgbuilder -c "\"${PYBIN}/python\" /io/tests/run-tests.py --with-hg=\"${PYBIN}/hg\" --blacklist=/io/contrib/packaging/linux-wheel-centos5-blacklist"

      done

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#!/bin/bash
				# This file is directly inspired by
				# https://github.com/pypa/python-manylinux-demo/blob/master/travis/build-wheels.sh
				set -e -x

				PYTHON_TARGETS=$(ls -d /opt/python/cp27*/bin)

				# Create an user for the tests
				useradd hgbuilder

				# Bypass uid/gid problems
				cp -R /src /io && chown -R hgbuilder:hgbuilder /io

				# Compile wheels for Python 2.X
				for PYBIN in $PYTHON_TARGETS; do
				"${PYBIN}/pip" wheel /io/ -w wheelhouse/
				done

				# Bundle external shared libraries into the wheels with
				# auditwheel (https://github.com/pypa/auditwheel) repair.
				# It also fix the ABI tag on the wheel making it pip installable.
				for whl in wheelhouse/*.whl; do
				auditwheel repair "$whl" -w /src/wheelhouse/
				done

				# Install packages and run the tests for all Python versions
				cd /io/tests/

				for PYBIN in $PYTHON_TARGETS; do
				# Install mercurial wheel as root
				"${PYBIN}/pip" install mercurial --no-index -f /src/wheelhouse
				# But run tests as hgbuilder user (non-root)
				su hgbuilder -c "\"${PYBIN}/python\" /io/tests/run-tests.py --with-hg=\"${PYBIN}/hg\" --blacklist=/io/contrib/packaging/linux-wheel-centos5-blacklist"
				done