upstream/mercurial-mirror Files · tests/md5sum.py

store: introduce _matchtrackedpath() and use it to filter store files...

store: introduce _matchtrackedpath() and use it to filter store files This patch introduces a function to filter store files on the basis of the path which they are tracking. The function assumes that the entries can be of two types, 'meta/*' and 'data/*' which means it will just work on revlog based storage and not with another storage ways. For the 'data/*' entries, we remove the 'data/' part and '.i/.d' part from the beginning and the end then pass that to matcher. For the 'meta/*' entries, we remove the 'meta/' and '/00manifest.(i/d)' part from beginning and end then call matcher.visitdir() with it to make sure all the parent directories are also downloaded. Since the storage filtering for narrow stream clones is implemented with this patch, we remove the un-implemented error message, add some more tests and add the treemanifest case to tests too. The tests demonstrate that it works correctly. After this patch, we have now narrow stream clones working. Narrow stream clones are a very important feature for large repositories who have good internet connection because they use streamclones for cloning and if they do normal narrow clone, that takes more time then a full streamclone. Also narrow-stream clone will drastically speed up clone timings. Differential Revision: https://phab.mercurial-scm.org/D5139

Augie Fackler - - Load All Authors

File last commit:

r33875:904bc1dc default


                r40529:9aeb9e2d

default

Download file

             md5sum.py
        
                    38 lines
            
             | 944 B
            
                | text/x-python
            
             |
                PythonLexer
            
             / tests / md5sum.py
          
                    History
                
                 |
                  Source
                 | Raw
                 |Copy content
                 |Copy permalink

        Thomas Arendsen Hein
    
Unified #! paths for python scripts and removed them for test modules.

              r4122
            
      #!/usr/bin/env python

        Peter van Dijk
    
clarify license on md5sum.py

              r1928
            
      #

      # Based on python's Tools/scripts/md5sum.py

      #

      # This software may be used and distributed according to the terms

      # of the PYTHON SOFTWARE FOUNDATION LICENSE VERSION 2, which is

      # GPL-compatible.

        Pulkit Goyal
    
py3: make files use absolute_import and print_function...

              r29485
            
      from __future__ import absolute_import

        Augie Fackler
    
md5sum: assume hashlib exists now that we're 2.7 only

              r33875
            
      import hashlib

        Pulkit Goyal
    
py3: make files use absolute_import and print_function...

              r29485
            
      import os

      import sys

        Dirkjan Ochtman
    
python 2.6 compatibility: compatibility wrappers for hash functions

              r6470
            
      try:

        Patrick Mezard
    
tests: Windows compatibility fixes...

              r7080
            
          import msvcrt

          msvcrt.setmode(sys.stdout.fileno(), os.O_BINARY)

          msvcrt.setmode(sys.stderr.fileno(), os.O_BINARY)

      except ImportError:

          pass

        Peter van Dijk
    
add md5sum.py required by fix in previous changeset

              r1924
            
      for filename in sys.argv[1:]:

          try:

              fp = open(filename, 'rb')

        Gregory Szorc
    
global: mass rewrite to use modern exception syntax...

              r25660
            
          except IOError as msg:

        Peter van Dijk
    
add md5sum.py required by fix in previous changeset

              r1924
            
              sys.stderr.write('%s: Can\'t open: %s\n' % (filename, msg))

              sys.exit(1)

        Thomas Arendsen Hein
    
Whitespace/Tab cleanup

              r3223
            
        Augie Fackler
    
md5sum: assume hashlib exists now that we're 2.7 only

              r33875
            
          m = hashlib.md5()

        Peter van Dijk
    
add md5sum.py required by fix in previous changeset

              r1924
            
          try:

        Augie Fackler
    
md5sum: adapt for python 3 support

              r32852
            
              for data in iter(lambda: fp.read(8192), b''):

        Peter van Dijk
    
add md5sum.py required by fix in previous changeset

              r1924
            
                  m.update(data)

        Gregory Szorc
    
global: mass rewrite to use modern exception syntax...

              r25660
            
          except IOError as msg:

        Peter van Dijk
    
add md5sum.py required by fix in previous changeset

              r1924
            
              sys.stderr.write('%s: I/O error: %s\n' % (filename, msg))

              sys.exit(1)

          sys.stdout.write('%s  %s\n' % (m.hexdigest(), filename))

      sys.exit(0)

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

Thomas Arendsen Hein Unified #! paths for python scripts and removed them for test modules.	r4122	#!/usr/bin/env python
Peter van Dijk clarify license on md5sum.py	r1928	#
		# Based on python's Tools/scripts/md5sum.py
		#
		# This software may be used and distributed according to the terms
		# of the PYTHON SOFTWARE FOUNDATION LICENSE VERSION 2, which is
		# GPL-compatible.

Pulkit Goyal py3: make files use absolute_import and print_function...	r29485	from __future__ import absolute_import

Augie Fackler md5sum: assume hashlib exists now that we're 2.7 only	r33875	import hashlib
Pulkit Goyal py3: make files use absolute_import and print_function...	r29485	import os
		import sys
Dirkjan Ochtman python 2.6 compatibility: compatibility wrappers for hash functions	r6470
		try:
Patrick Mezard tests: Windows compatibility fixes...	r7080	import msvcrt
		msvcrt.setmode(sys.stdout.fileno(), os.O_BINARY)
		msvcrt.setmode(sys.stderr.fileno(), os.O_BINARY)
		except ImportError:
		pass

Peter van Dijk add md5sum.py required by fix in previous changeset	r1924	for filename in sys.argv[1:]:
		try:
		fp = open(filename, 'rb')
Gregory Szorc global: mass rewrite to use modern exception syntax...	r25660	except IOError as msg:
Peter van Dijk add md5sum.py required by fix in previous changeset	r1924	sys.stderr.write('%s: Can\'t open: %s\n' % (filename, msg))
		sys.exit(1)
Thomas Arendsen Hein Whitespace/Tab cleanup	r3223
Augie Fackler md5sum: assume hashlib exists now that we're 2.7 only	r33875	m = hashlib.md5()
Peter van Dijk add md5sum.py required by fix in previous changeset	r1924	try:
Augie Fackler md5sum: adapt for python 3 support	r32852	for data in iter(lambda: fp.read(8192), b''):
Peter van Dijk add md5sum.py required by fix in previous changeset	r1924	m.update(data)
Gregory Szorc global: mass rewrite to use modern exception syntax...	r25660	except IOError as msg:
Peter van Dijk add md5sum.py required by fix in previous changeset	r1924	sys.stderr.write('%s: I/O error: %s\n' % (filename, msg))
		sys.exit(1)
		sys.stdout.write('%s %s\n' % (m.hexdigest(), filename))

		sys.exit(0)