upstream/mercurial-mirror Files · mercurial/utils/memorytop.py

persistent-nodemap: properly ignore non-existent `.nd` data file...

persistent-nodemap: properly ignore non-existent `.nd` data file This code was meant to handle the case of a nodemap docket file pointing to a nodemap data file that doesn’t exist (anymore), but most likely caused an `UnboundLocalError` exception instead when `data` was used on the next line without being defined. This case is theoretically possible with a race condition between two hg processes, but is hard to reproduce or test: * Process A reads a docket file and finds a UID in it that points to a given data file name. * Process B decides that this same data file needs compacting. It writes a new one with a different UID, overwrites the docket file, then removes the old data file. * Only then process A tries to a open a file that doesn’t exist anymore. Differential Revision: https://phab.mercurial-scm.org/D9533

Joerg Sonnenberger - - Load All Authors

File last commit:

r46393:5b6c0af0 default


                r46705:8ff2d835

default

Download file

             memorytop.py
        
                    44 lines
            
             | 1.4 KiB
            
                | text/x-python
            
             |
                PythonLexer
            
             / mercurial / utils / memorytop.py
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      # memorytop requires Python 3.4

      #

      # Usage: set PYTHONTRACEMALLOC=n in the environment of the hg invocation,

      # where n>= is the number of frames to show in the backtrace. Put calls to

      # memorytop in strategic places to show the current memory use by allocation

      # site.

      import gc

      import tracemalloc

      def memorytop(limit=10):

          gc.collect()

          snapshot = tracemalloc.take_snapshot()

          snapshot = snapshot.filter_traces(

              (

                  tracemalloc.Filter(False, "<frozen importlib._bootstrap>"),

                  tracemalloc.Filter(False, "<frozen importlib._bootstrap_external>"),

                  tracemalloc.Filter(False, "<unknown>"),

              )

          )

          stats = snapshot.statistics('traceback')

          total = sum(stat.size for stat in stats)

          print("\nTotal allocated size: %.1f KiB\n" % (total / 1024))

          print("Lines with the biggest net allocations")

          for index, stat in enumerate(stats[:limit], 1):

              print(

                  "#%d: %d objects using %.1f KiB"

                  % (index, stat.count, stat.size / 1024)

              )

              for line in stat.traceback.format(most_recent_first=True):

                  print('    ', line)

          other = stats[limit:]

          if other:

              size = sum(stat.size for stat in other)

              count = sum(stat.count for stat in other)

              print(

                  "%s other: %d objects using %.1f KiB"

                  % (len(other), count, size / 1024)

              )

          print()

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				# memorytop requires Python 3.4
				#
				# Usage: set PYTHONTRACEMALLOC=n in the environment of the hg invocation,
				# where n>= is the number of frames to show in the backtrace. Put calls to
				# memorytop in strategic places to show the current memory use by allocation
				# site.

				import gc
				import tracemalloc


				def memorytop(limit=10):
				gc.collect()
				snapshot = tracemalloc.take_snapshot()

				snapshot = snapshot.filter_traces(
				(
				tracemalloc.Filter(False, "<frozen importlib._bootstrap>"),
				tracemalloc.Filter(False, "<frozen importlib._bootstrap_external>"),
				tracemalloc.Filter(False, "<unknown>"),
				)
				)
				stats = snapshot.statistics('traceback')

				total = sum(stat.size for stat in stats)
				print("\nTotal allocated size: %.1f KiB\n" % (total / 1024))
				print("Lines with the biggest net allocations")
				for index, stat in enumerate(stats[:limit], 1):
				print(
				"#%d: %d objects using %.1f KiB"
				% (index, stat.count, stat.size / 1024)
				)
				for line in stat.traceback.format(most_recent_first=True):
				print(' ', line)

				other = stats[limit:]
				if other:
				size = sum(stat.size for stat in other)
				count = sum(stat.count for stat in other)
				print(
				"%s other: %d objects using %.1f KiB"
				% (len(other), count, size / 1024)
				)
				print()