upstream/mercurial-mirror Files · contrib/fuzz/fm1readmarkers.cc

revlog: add a small cache of unfiltered chunk...

revlog: add a small cache of unfiltered chunk This can provides a massive boost to the reading of multiple revision and the computation of a valid delta chain. This greatly help operation like `hg log --patch`, delta computation (helping pull/unbundle), linkrev adjustment (helping copy tracing). A first round of benchmark for `hg log --patch --limit 1000` shows improvement in the 10-20% range on "small" repository like pypy or mercurial and large improvements (about 33%) for more complex ones like netbeans and mozilla's. These speeds up are consistent with the improvement to `hg pull` (from a server sending poor deltas) I saw benchmarking this last year. Further benchmark will be run during the freeze. I added some configuration in the experimental space to be able to further test the effect of various tuning for now. This feature should fit well in the "usage/resource profile" configuration that we should land next cycle. When it does not provides a benefit the overhead of the cache seem to be around 2%, a small price for the big improvement. In addition I believe we could shave most of this overhead with a more efficent lru implementation.

Augie Fackler - - Load All Authors

File last commit:

r44311:8766728d default


                r52001:0250e450

default

Download file

             fm1readmarkers.cc
        
                    59 lines
            
             | 1.4 KiB
            
                | text/x-c
            
             |
                CppLexer
            
             / contrib / fuzz / fm1readmarkers.cc
          
                    History
                
                 |
                  Annotation
                 | Raw
                 |Copy content
                 |Copy permalink

      #include <Python.h>

      #include <assert.h>

      #include <stdlib.h>

      #include <unistd.h>

      #include <string>

      #include "pyutil.h"

      extern "C" {

      static PYCODETYPE *code;

      extern "C" int LLVMFuzzerInitialize(int *argc, char ***argv)

      {

      	contrib::initpy(*argv[0]);

      	code = (PYCODETYPE *)Py_CompileString(R"py(

      def maybeint(s, default):

          try:

              return int(s)

          except ValueError:

              return default

      try:

          parts = data.split('\0', 2)

          if len(parts) == 3:

              offset, stop, data = parts

          elif len(parts) == 2:

              stop, data = parts

              offset = 0

          else:

              offset = stop = 0

          offset, stop = maybeint(offset, 0), maybeint(stop, len(data))

          parsers.fm1readmarkers(data, offset, stop)

      except Exception as e:

          pass

          # uncomment this print if you're editing this Python code

          # to debug failures.

          # print e

      )py",

      	                                      "fuzzer", Py_file_input);

      	return 0;

      }

      int LLVMFuzzerTestOneInput(const uint8_t *Data, size_t Size)

      {

      	PyObject *text =

      	    PyBytes_FromStringAndSize((const char *)Data, (Py_ssize_t)Size);

      	PyObject *locals = PyDict_New();

      	PyDict_SetItemString(locals, "data", text);

      	PyObject *res = PyEval_EvalCode(code, contrib::pyglobals(), locals);

      	if (!res) {

      		PyErr_Print();

      	}

      	Py_XDECREF(res);

      	Py_DECREF(locals);

      	Py_DECREF(text);

      	return 0; // Non-zero return values are reserved for future use.

      }

      }

	Site-wide shortcuts
/	Use quick search box
g h	Goto home page
g g	Goto my private gists page
g G	Goto my public gists page
g 0-9	Goto bookmarked items from 0-9
n r	New repository page
n g	New gist page

	Repositories
g s	Goto summary page
g c	Goto changelog page
g f	Goto files page
g F	Goto files page with file search activated
g p	Goto pull requests page
g o	Goto repository settings
g O	Goto repository access permissions settings
t s	Toggle sidebar on some pages

				#include <Python.h>
				#include <assert.h>
				#include <stdlib.h>
				#include <unistd.h>

				#include <string>

				#include "pyutil.h"

				extern "C" {

				static PYCODETYPE *code;

				extern "C" int LLVMFuzzerInitialize(int argc, char **argv)
				{
				contrib::initpy(*argv[0]);
				code = (PYCODETYPE *)Py_CompileString(R"py(
				def maybeint(s, default):
				try:
				return int(s)
				except ValueError:
				return default
				try:
				parts = data.split('\0', 2)
				if len(parts) == 3:
				offset, stop, data = parts
				elif len(parts) == 2:
				stop, data = parts
				offset = 0
				else:
				offset = stop = 0
				offset, stop = maybeint(offset, 0), maybeint(stop, len(data))
				parsers.fm1readmarkers(data, offset, stop)
				except Exception as e:
				pass
				# uncomment this print if you're editing this Python code
				# to debug failures.
				# print e
				)py",
				"fuzzer", Py_file_input);
				return 0;
				}

				int LLVMFuzzerTestOneInput(const uint8_t *Data, size_t Size)
				{
				PyObject *text =
				PyBytes_FromStringAndSize((const char *)Data, (Py_ssize_t)Size);
				PyObject *locals = PyDict_New();
				PyDict_SetItemString(locals, "data", text);
				PyObject *res = PyEval_EvalCode(code, contrib::pyglobals(), locals);
				if (!res) {
				PyErr_Print();
				}
				Py_XDECREF(res);
				Py_DECREF(locals);
				Py_DECREF(text);
				return 0; // Non-zero return values are reserved for future use.
				}
				}