upstream/mercurial-mirror Files · contrib/check-pytype.sh

streamclone: disable the volatile file open handle optimization on Windows...

streamclone: disable the volatile file open handle optimization on Windows Leaving files open caused new failures like this, since a47f09da8bd1: diff --git a/tests/test-persistent-nodemap-stream-clone.t b/tests/test-persistent-nodemap-stream-clone.t --- a/tests/test-persistent-nodemap-stream-clone.t +++ b/tests/test-persistent-nodemap-stream-clone.t @@ -115,7 +115,12 @@ Do a mix of clone and commit at the same $ (hg clone -U --stream ssh://user@dummy/test-repo stream-clone-race-1 --debug 2>> clone-output | grep -E '00(changelog|manifest)' >> clone-output; touch $HG_TEST_STREAM_WALKED_FILE_3) & $ $RUNTESTDIR/testlib/wait-on-file 10 $HG_TEST_STREAM_WALKED_FILE_1 $ hg -R test-repo/ commit -m foo - created new head + transaction abort! + failed to recover 00changelog.n ([WinError 32] The process cannot access the file because it is being used by another process: b'$STR_REPR_TESTTMP\\test-repo/.hg/store/00changelog.n' -> b'$STR_REPR_TESTTMP\\test-repo/.hg/store/00changelog.n-f418dcd6') + rollback failed - please run hg recover + (failure reason: [WinError 32] The process cannot access the file because it is being used by another process: b'$STR_REPR_TESTTMP\\test-repo/.hg/store/00changelog.n' -> b'$STR_REPR_TESTTMP\\test-repo/.hg/store/00changelog.n-f418dcd6') + abort: The process cannot access the file because it is being used by another process: '$TESTTMP\test-repo\.hg\store\00changelog.n' + [255] $ touch $HG_TEST_STREAM_WALKED_FILE_2 $ $RUNTESTDIR/testlib/wait-on-file 10 $HG_TEST_STREAM_WALKED_FILE_3 $ cat clone-output Since the `VolatileManager` falls back to the old copy method when the open file threshold is exceeded, this just drops the threshold so that only 1 file is open. The actual value used (2) is unexpected, and explained inline. I'd like to have a config option for this so that we can test both ways (in theory, it could resort to copies on non-Windows systems too), but I don't see a `uimod.ui` handy. Alternately, I tried replacing the 3 `open()` calls in the `VolatileManager` with `util.posixfile()`, but that simply hung the test on Windows for some reason, I think on the same line that's indicated as failing above. (There was a `grep` command hanging around, as well as `hg -R test-repo serve --stdio`.)

Matt Harbison - - Load All Authors

File last commit:

r53024:2dce4c01 default


                r53081:e4b242f9

stable

Download file

             check-pytype.sh
        
                    124 lines
            
             | 5.4 KiB
            
                | application/x-sh
            
             |
                BashLexer
            
             / contrib / check-pytype.sh
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #!/bin/sh

      set -e

      set -u

      cd "$(hg root)"

      printf "pytype version: "

      pytype --version

      # Many of the individual files that are excluded here confuse pytype

      # because they do a mix of Python 2 and Python 3 things

      # conditionally. There's no good way to help it out with that as far as

      # I can tell, so let's just hide those files from it for now. We should

      # endeavor to empty this list out over time, as some of these are

      # probably hiding real problems.

      #

      # hgext/absorb.py               # [attribute-error]

      # hgext/bugzilla.py             # [pyi-error], [attribute-error]

      # hgext/convert/bzr.py          # [attribute-error]

      # hgext/convert/cvs.py          # [attribute-error], [wrong-arg-types]

      # hgext/convert/cvsps.py        # [attribute-error]

      # hgext/convert/p4.py           # [wrong-arg-types] (__file: mercurial.utils.procutil._pfile -> IO)

      # hgext/convert/subversion.py   # [attribute-error], [name-error], [pyi-error]

      # hgext/fastannotate/context.py # no linelog.copyfrom()

      # hgext/fastannotate/formatter.py  # [unsupported-operands]

      # hgext/fsmonitor/__init__.py   # [name-error]

      # hgext/git/__init__.py         # [attribute-error]

      # hgext/githelp.py              # [attribute-error] [wrong-arg-types]

      # hgext/hgk.py                  # [attribute-error]

      # hgext/histedit.py             # [attribute-error], [wrong-arg-types]

      # hgext/keyword.py              # [attribute-error]

      # hgext/largefiles/storefactory.py  # [attribute-error]

      # hgext/lfs/__init__.py         # [attribute-error]

      # hgext/narrow/narrowbundle2.py # [attribute-error]

      # hgext/narrow/narrowcommands.py    # [attribute-error], [name-error]

      # hgext/rebase.py               # [attribute-error]

      # hgext/remotefilelog/basepack.py   # [attribute-error], [wrong-arg-count]

      # hgext/remotefilelog/basestore.py  # [attribute-error]

      # hgext/remotefilelog/contentstore.py   # [missing-parameter], [wrong-keyword-args], [attribute-error]

      # hgext/remotefilelog/fileserverclient.py  # [attribute-error]

      # hgext/remotefilelog/shallowbundle.py     # [attribute-error]

      # hgext/remotefilelog/remotefilectx.py  # [module-attr] (This is an actual bug)

      # hgext/sqlitestore.py          # [attribute-error]

      # hgext/zeroconf/__init__.py    # bytes vs str; tests fail on macOS

      #

      # mercurial/context.py          # many [attribute-error]

      # mercurial/crecord.py          # tons of [attribute-error], [module-attr]

      # mercurial/debugcommands.py    # [wrong-arg-types]

      # mercurial/dispatch.py         # initstdio: No attribute ... on TextIO [attribute-error]

      # mercurial/exchange.py         # [attribute-error]

      # mercurial/hgweb/hgweb_mod.py  # [attribute-error], [name-error], [wrong-arg-types]

      # mercurial/hgweb/server.py     # [attribute-error], [name-error], [module-attr]

      # mercurial/hgweb/wsgicgi.py    # confused values in os.environ

      # mercurial/httppeer.py         # [attribute-error], [wrong-arg-types]

      # mercurial/interfaces          # No attribute 'capabilities' on peer [attribute-error]

      # mercurial/keepalive.py        # [attribute-error]

      # mercurial/localrepo.py        # [attribute-error]

      # mercurial/minirst.py          # [unsupported-operands], [attribute-error]

      # mercurial/pure/parsers.py     # [attribute-error]

      # mercurial/repoview.py         # [attribute-error]

      # mercurial/testing/storage.py  # tons of [attribute-error]

      # mercurial/win32.py            # [not-callable]

      # mercurial/wireprotov1server.py  # BUG?: BundleValueError handler accesses subclass's attrs

      # TODO: use --no-cache on test server?  Caching the files locally helps during

      #       development, but may be a hinderance for CI testing.

      # TODO: include hgext and hgext3rd

      pytype --keep-going --jobs auto \

          doc/check-seclevel.py hgdemandimport hgext mercurial \

          -x hgext/absorb.py \

          -x hgext/bugzilla.py \

          -x hgext/convert/bzr.py \

          -x hgext/convert/cvs.py \

          -x hgext/convert/cvsps.py \

          -x hgext/convert/p4.py \

          -x hgext/convert/subversion.py \

          -x hgext/fastannotate/context.py \

          -x hgext/fastannotate/formatter.py \

          -x hgext/fsmonitor/__init__.py \

          -x hgext/git/__init__.py \

          -x hgext/githelp.py \

          -x hgext/hgk.py \

          -x hgext/histedit.py \

          -x hgext/keyword.py \

          -x hgext/largefiles/storefactory.py \

          -x hgext/lfs/__init__.py \

          -x hgext/narrow/narrowbundle2.py \

          -x hgext/narrow/narrowcommands.py \

          -x hgext/rebase.py \

          -x hgext/remotefilelog/basepack.py \

          -x hgext/remotefilelog/basestore.py \

          -x hgext/remotefilelog/contentstore.py \

          -x hgext/remotefilelog/fileserverclient.py \

          -x hgext/remotefilelog/remotefilectx.py \

          -x hgext/remotefilelog/shallowbundle.py \

          -x hgext/sqlitestore.py \

          -x hgext/zeroconf/__init__.py \

          -x mercurial/context.py \

          -x mercurial/crecord.py \

          -x mercurial/debugcommands.py \

          -x mercurial/dispatch.py \

          -x mercurial/exchange.py \

          -x mercurial/hgweb/hgweb_mod.py \

          -x mercurial/hgweb/server.py \

          -x mercurial/hgweb/wsgicgi.py \

          -x mercurial/httppeer.py \

          -x mercurial/interfaces \

          -x mercurial/keepalive.py \

          -x mercurial/localrepo.py \

          -x mercurial/minirst.py \

          -x mercurial/pure/parsers.py \

          -x mercurial/repoview.py \

          -x mercurial/testing/storage.py \

          -x mercurial/thirdparty \

          -x mercurial/win32.py \

          -x mercurial/wireprotov1server.py

      if find .pytype/pyi -name '*.pyi' | xargs grep -ql '# Caught error'; then

          echo 'pytype crashed while generating the following type stubs:'

          find .pytype/pyi -name '*.pyi' | xargs grep -l '# Caught error' | sort

      fi

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#!/bin/sh

				set -e
				set -u

				cd "$(hg root)"

				printf "pytype version: "
				pytype --version

				# Many of the individual files that are excluded here confuse pytype
				# because they do a mix of Python 2 and Python 3 things
				# conditionally. There's no good way to help it out with that as far as
				# I can tell, so let's just hide those files from it for now. We should
				# endeavor to empty this list out over time, as some of these are
				# probably hiding real problems.
				#
				# hgext/absorb.py # [attribute-error]
				# hgext/bugzilla.py # [pyi-error], [attribute-error]
				# hgext/convert/bzr.py # [attribute-error]
				# hgext/convert/cvs.py # [attribute-error], [wrong-arg-types]
				# hgext/convert/cvsps.py # [attribute-error]
				# hgext/convert/p4.py # [wrong-arg-types] (__file: mercurial.utils.procutil._pfile -> IO)
				# hgext/convert/subversion.py # [attribute-error], [name-error], [pyi-error]
				# hgext/fastannotate/context.py # no linelog.copyfrom()
				# hgext/fastannotate/formatter.py # [unsupported-operands]
				# hgext/fsmonitor/__init__.py # [name-error]
				# hgext/git/__init__.py # [attribute-error]
				# hgext/githelp.py # [attribute-error] [wrong-arg-types]
				# hgext/hgk.py # [attribute-error]
				# hgext/histedit.py # [attribute-error], [wrong-arg-types]
				# hgext/keyword.py # [attribute-error]
				# hgext/largefiles/storefactory.py # [attribute-error]
				# hgext/lfs/__init__.py # [attribute-error]
				# hgext/narrow/narrowbundle2.py # [attribute-error]
				# hgext/narrow/narrowcommands.py # [attribute-error], [name-error]
				# hgext/rebase.py # [attribute-error]
				# hgext/remotefilelog/basepack.py # [attribute-error], [wrong-arg-count]
				# hgext/remotefilelog/basestore.py # [attribute-error]
				# hgext/remotefilelog/contentstore.py # [missing-parameter], [wrong-keyword-args], [attribute-error]
				# hgext/remotefilelog/fileserverclient.py # [attribute-error]
				# hgext/remotefilelog/shallowbundle.py # [attribute-error]
				# hgext/remotefilelog/remotefilectx.py # [module-attr] (This is an actual bug)
				# hgext/sqlitestore.py # [attribute-error]
				# hgext/zeroconf/__init__.py # bytes vs str; tests fail on macOS
				#
				# mercurial/context.py # many [attribute-error]
				# mercurial/crecord.py # tons of [attribute-error], [module-attr]
				# mercurial/debugcommands.py # [wrong-arg-types]
				# mercurial/dispatch.py # initstdio: No attribute ... on TextIO [attribute-error]
				# mercurial/exchange.py # [attribute-error]
				# mercurial/hgweb/hgweb_mod.py # [attribute-error], [name-error], [wrong-arg-types]
				# mercurial/hgweb/server.py # [attribute-error], [name-error], [module-attr]
				# mercurial/hgweb/wsgicgi.py # confused values in os.environ
				# mercurial/httppeer.py # [attribute-error], [wrong-arg-types]
				# mercurial/interfaces # No attribute 'capabilities' on peer [attribute-error]
				# mercurial/keepalive.py # [attribute-error]
				# mercurial/localrepo.py # [attribute-error]
				# mercurial/minirst.py # [unsupported-operands], [attribute-error]
				# mercurial/pure/parsers.py # [attribute-error]
				# mercurial/repoview.py # [attribute-error]
				# mercurial/testing/storage.py # tons of [attribute-error]
				# mercurial/win32.py # [not-callable]
				# mercurial/wireprotov1server.py # BUG?: BundleValueError handler accesses subclass's attrs

				# TODO: use --no-cache on test server? Caching the files locally helps during
				# development, but may be a hinderance for CI testing.

				# TODO: include hgext and hgext3rd

				pytype --keep-going --jobs auto \
				doc/check-seclevel.py hgdemandimport hgext mercurial \
				-x hgext/absorb.py \
				-x hgext/bugzilla.py \
				-x hgext/convert/bzr.py \
				-x hgext/convert/cvs.py \
				-x hgext/convert/cvsps.py \
				-x hgext/convert/p4.py \
				-x hgext/convert/subversion.py \
				-x hgext/fastannotate/context.py \
				-x hgext/fastannotate/formatter.py \
				-x hgext/fsmonitor/__init__.py \
				-x hgext/git/__init__.py \
				-x hgext/githelp.py \
				-x hgext/hgk.py \
				-x hgext/histedit.py \
				-x hgext/keyword.py \
				-x hgext/largefiles/storefactory.py \
				-x hgext/lfs/__init__.py \
				-x hgext/narrow/narrowbundle2.py \
				-x hgext/narrow/narrowcommands.py \
				-x hgext/rebase.py \
				-x hgext/remotefilelog/basepack.py \
				-x hgext/remotefilelog/basestore.py \
				-x hgext/remotefilelog/contentstore.py \
				-x hgext/remotefilelog/fileserverclient.py \
				-x hgext/remotefilelog/remotefilectx.py \
				-x hgext/remotefilelog/shallowbundle.py \
				-x hgext/sqlitestore.py \
				-x hgext/zeroconf/__init__.py \
				-x mercurial/context.py \
				-x mercurial/crecord.py \
				-x mercurial/debugcommands.py \
				-x mercurial/dispatch.py \
				-x mercurial/exchange.py \
				-x mercurial/hgweb/hgweb_mod.py \
				-x mercurial/hgweb/server.py \
				-x mercurial/hgweb/wsgicgi.py \
				-x mercurial/httppeer.py \
				-x mercurial/interfaces \
				-x mercurial/keepalive.py \
				-x mercurial/localrepo.py \
				-x mercurial/minirst.py \
				-x mercurial/pure/parsers.py \
				-x mercurial/repoview.py \
				-x mercurial/testing/storage.py \
				-x mercurial/thirdparty \
				-x mercurial/win32.py \
				-x mercurial/wireprotov1server.py

				if find .pytype/pyi -name '*.pyi' \| xargs grep -ql '# Caught error'; then
				echo 'pytype crashed while generating the following type stubs:'
				find .pytype/pyi -name '*.pyi' \| xargs grep -l '# Caught error' \| sort
				fi