notmuch/test/test-lib.sh, branch 0.36

perf-test: allow running test_emacs from performance test suite.

2022-02-25T12:38:03Z

test_require_external prereq has to move to test-lib-common.sh, and the new shell functions print_emacs_header and time_emacs are provided. The somewhat indirect way of printing the output is to avoid the extra "" present on string values from emacsclient.

test: split variable settings to their own file

2022-02-25T12:37:14Z

This allows sharing more variable settings between the (correctness) tests and the performance-tests. Unfortunately it seems a bit tricky to move settings to test-lib-common.sh, as that is sourced late in test-lib.sh, and moving it earlier breaks things.

test: sanitize generated message files names

2022-01-27T11:48:27Z

It is fragile to encode the generated names into tests, as it makes tests break when e.g. new tests are added. There is a possibility that this will hide certain failures; in that case meaningful filenames should be chosen for the generated messages.

test: define test_expect_equal_message_body

2022-01-26T11:22:09Z

This is a relatively simple sed invocation, but rather than write a comment everywhere, give it a descriptive name.

Merge remote-tracking branch 'origin/release'

2022-01-12T17:25:29Z

test/gpgsm: use --with-colons when calculating fingerprint.

2022-01-12T17:22:51Z

As stressed by the gpg documentation, the non-'with-colons' output format is subject to change, and indeed it did in 2.3.x (x<=3). This should make the the test suite more robust against such changes.

test: remove directory names from paths in exceptions

2021-12-23T12:47:40Z

These cause failures when building out of tree.

test: add python-cffi bindings to path for test_python

2021-12-04T12:36:23Z

This will allow testing the new python bindings using test_python, in addition to the current invocation of pytest.

test/T355-smime: Use key as exported by gpgsm

2021-09-29T23:04:31Z

As reported in id:87h7pxiek3.fsf@tethera.net, the previous version of the test is flaky. There is some so-far undebugged interaction between openssl and gpgsm that causes the keys to fail to import. As a potential workaround, use the key as exported by gpgsm, and eliminate openssl from this particular pipeline.

test: add test_expect_equal_file_nonempty

2021-08-21T21:55:41Z

A common bug in tests is that the code used to generate the EXPECTED file fails, generating no output. When the code generating the OUTPUT file fails in the same way, the test passes, even though there is a failure being hidden. Add a new test function that guards against this.