upstream/mercurial-mirror Files · tests/test-largefiles-small-disk.t

hgweb: profile HTTP requests...

hgweb: profile HTTP requests Currently, running `hg serve --profile` doesn't yield anything useful: when the process is terminated the profiling output displays results from the main thread, which typically spends most of its time in select.select(). Furthermore, it has no meaningful results from mercurial.* modules because the threads serving HTTP requests don't actually get profiled. This patch teaches the hgweb wsgi applications to profile individual requests. If profiling is enabled, the profiler kicks in after HTTP/WSGI environment processing but before Mercurial's main request processing. The profile results are printed to the configured profiling output. If running `hg serve` from a shell, they will be printed to stderr, just before the HTTP request line is logged. If profiling to a file, we only write a single profile to the file because the file is not opened in append mode. We could add support for appending to files in a future patch if someone wants it. Per request profiling doesn't work with the statprof profiler because internally that profiler collects samples from the thread that *initially* requested profiling be enabled. I have plans to address this by vendoring Facebook's customized statprof and then improving it.

Mads Kiilerich - - Load All Authors

File last commit:

r20063:8a021cd3 stable


                r29787:80df0426

default

Download file

             test-largefiles-small-disk.t
        
                    67 lines
            
             | 1.7 KiB
            
                | text/troff
            
             |
                Tads3Lexer
            
             / tests / test-largefiles-small-disk.t
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      Test how largefiles abort in case the disk runs full

        $ cat > criple.py <<EOF

        > import os, errno, shutil

        > from mercurial import util

        > #

        > # this makes the original largefiles code abort:

        > def copyfileobj(fsrc, fdst, length=16*1024):

        >     fdst.write(fsrc.read(4))

        >     raise IOError(errno.ENOSPC, os.strerror(errno.ENOSPC))

        > shutil.copyfileobj = copyfileobj

        > #

        > # this makes the rewritten code abort:

        > def filechunkiter(f, size=65536, limit=None):

        >     yield f.read(4)

        >     raise IOError(errno.ENOSPC, os.strerror(errno.ENOSPC))

        > util.filechunkiter = filechunkiter

        > #

        > def oslink(src, dest):

        >     raise OSError("no hardlinks, try copying instead")

        > util.oslink = oslink

        > EOF

        $ echo "[extensions]" >> $HGRCPATH

        $ echo "largefiles =" >> $HGRCPATH

        $ hg init alice

        $ cd alice

        $ echo "this is a very big file" > big

        $ hg add --large big

        $ hg commit --config extensions.criple=$TESTTMP/criple.py -m big

        abort: No space left on device

        [255]

      The largefile is not created in .hg/largefiles:

        $ ls .hg/largefiles

        dirstate

      The user cache is not even created:

        >>> import os; os.path.exists("$HOME/.cache/largefiles/")

        False

      Make the commit with space on the device:

        $ hg commit -m big

      Now make a clone with a full disk, and make sure lfutil.link function

      makes copies instead of hardlinks:

        $ cd ..

        $ hg --config extensions.criple=$TESTTMP/criple.py clone --pull alice bob

        requesting all changes

        adding changesets

        adding manifests

        adding file changes

        added 1 changesets with 1 changes to 1 files

        updating to branch default

        getting changed largefiles

        abort: No space left on device

        [255]

      The largefile is not created in .hg/largefiles:

        $ ls bob/.hg/largefiles

        dirstate

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				Test how largefiles abort in case the disk runs full

				$ cat > criple.py <<EOF
				> import os, errno, shutil
				> from mercurial import util
				> #
				> # this makes the original largefiles code abort:
				> def copyfileobj(fsrc, fdst, length=16*1024):
				> fdst.write(fsrc.read(4))
				> raise IOError(errno.ENOSPC, os.strerror(errno.ENOSPC))
				> shutil.copyfileobj = copyfileobj
				> #
				> # this makes the rewritten code abort:
				> def filechunkiter(f, size=65536, limit=None):
				> yield f.read(4)
				> raise IOError(errno.ENOSPC, os.strerror(errno.ENOSPC))
				> util.filechunkiter = filechunkiter
				> #
				> def oslink(src, dest):
				> raise OSError("no hardlinks, try copying instead")
				> util.oslink = oslink
				> EOF

				$ echo "[extensions]" >> $HGRCPATH
				$ echo "largefiles =" >> $HGRCPATH

				$ hg init alice
				$ cd alice
				$ echo "this is a very big file" > big
				$ hg add --large big
				$ hg commit --config extensions.criple=$TESTTMP/criple.py -m big
				abort: No space left on device
				[255]

				The largefile is not created in .hg/largefiles:

				$ ls .hg/largefiles
				dirstate

				The user cache is not even created:

				>>> import os; os.path.exists("$HOME/.cache/largefiles/")
				False

				Make the commit with space on the device:

				$ hg commit -m big

				Now make a clone with a full disk, and make sure lfutil.link function
				makes copies instead of hardlinks:

				$ cd ..
				$ hg --config extensions.criple=$TESTTMP/criple.py clone --pull alice bob
				requesting all changes
				adding changesets
				adding manifests
				adding file changes
				added 1 changesets with 1 changes to 1 files
				updating to branch default
				getting changed largefiles
				abort: No space left on device
				[255]

				The largefile is not created in .hg/largefiles:

				$ ls bob/.hg/largefiles
				dirstate