notmuch/performance-test, branch 0.16_rc2

build: fix out-of-tree builds

2013-05-26T21:49:04Z

Support for out-of-tree builds was added in commit 3e4a9d60a9419621b08c647a306843d76c47c2cb Author: Carl Worth Date: Wed Mar 9 15:02:42 2011 -0800 build: Add support for non-source-directory builds. and broken in commit 7beeb8c88a014ecbc53d8241f10683b3c4c16228 Author: David Bremner Date: Sat Nov 17 12:28:15 2012 -0400 test: initial performance testing infrastructure Fix the build breakage. Out-of-tree 'make test' has been broken since earlier than the above, and remains broken, as does out-of-tree perf test, but at least the build now works.

perf-test: add notmuch-memory-test

2013-05-16T01:23:29Z

Somehow this file was not added to the patch set which split the tests into time and memory tests. Take advantage of the the "new" way of running tests to avoid listing the explicitly.

perf-test: run all appropriately named time tests

2013-05-16T01:23:29Z

This avoids hassle with manually adding every test to the master list.

perf-test: rename time tests to have .sh suffix

2013-05-16T01:23:29Z

This will simplify notmuch time tests

perf-test: rename memory tests

2013-05-16T01:23:29Z

The common suffix will help running them all automatically.

perf-test: initial support for talloc leak report in memory tests

2012-12-31T01:12:11Z

As with the valgrind logs, we print a (very) brief summary and leave the log for inspection.

perf-test: add memory leak test for dump restore

2012-12-25T12:49:24Z

In id:87vcc2q5n2.fsf@nikula.org, Jani points out a memory leak in the current version of the sup restore code. Among other things, this test is intended to verify a fix for that leak.

perf-test: initial version of memory test infrastructure.

2012-12-25T12:49:24Z

The idea is run some code under valgrind --leak-check=full and report a summary, leaving the user to peruse the log file if they want. We go to some lengths to preserve the log files from accidental overwriting; the full corpus takes about 3 hours to run under valgrind on my machine. The naming of the log directories may be slightly controversial; in the unlikely event of two runs in less than a second, the log will be overwritten. A previous version with mktemp+timestamp was dismissed as overkill; just mktemp alone does not sort nicely. One new test is included, to check notmuch new for memory leaks.

perf-test: rename current tests as "time tests"

2012-12-25T12:49:24Z

This is almost entirely renaming files, except for updating a few references to those file names, and changing the makefile target. A new set of memory tests will be run separately because they take much longer.

perf-test: remove redundant "initial notmuch new"

2012-12-25T12:49:24Z

The initial notmuch-new and caching are now done automatically by time_start