diff options
| author | David Bremner <david@tethera.net> | 2017-08-27 15:54:50 -0300 |
|---|---|---|
| committer | David Bremner <david@tethera.net> | 2017-08-27 15:54:50 -0300 |
| commit | a565f71e1c160431ff99f088bc8fc08d367603a2 (patch) | |
| tree | 2f7c33d7296e15b2c33f6ede436d412c812c3f15 /test/README | |
| parent | 00f87faf4bc19e90e19b8b27c13845efb6a68152 (diff) | |
| parent | 6354745dcd6505c5f12c185a29c25a8d1c240595 (diff) | |
Merge tag 'debian/0.25-6' into debian/stretch-backports
Diffstat (limited to 'test/README')
| -rw-r--r-- | test/README | 34 |
1 files changed, 25 insertions, 9 deletions
diff --git a/test/README b/test/README index 104a120e..8e06f442 100644 --- a/test/README +++ b/test/README @@ -26,13 +26,24 @@ that you know if you break anything. - gpg(1) - python(1) -If your system lacks these tools or have older, non-upgreable versions +If your system lacks these tools or have older, non-upgradable versions of these, please (possibly compile and) install these to some other path, for example /usr/local/bin or /opt/gnu/bin. Then prepend the chosen directory to your PATH before running the tests. e.g. env PATH=/opt/gnu/bin:$PATH make test +For FreeBSD you need to install latest gdb from ports or packages and +provide path to it in TEST_GDB environment variable before executing +the tests, native FreeBSD gdb does not not work. If you install +coreutils, which provides GNU versions of basic utils like 'date' and +'base64' on FreeBSD, the test suite will use these instead of the +native ones. This provides robustness against portability issues with +these system tools. Most often the tests are written, reviewed and +tested on Linux system so such portability issues arise from time to +time. + + Running Tests ------------- The easiest way to run tests is to say "make test", (or simply run the @@ -133,9 +144,9 @@ remaining tests to be unaffected. Currently we do not consider skipped tests as build failures. For maximum robustness, when setting up automated build processes, you -should explicitely skip tests, rather than relying on notmuch's +should explicitly skip tests, rather than relying on notmuch's detection of missing prerequisites. In the future we may treat tests -unable to run because of missing prerequisites, but not explicitely +unable to run because of missing prerequisites, but not explicitly skipped by the user, as failures. Writing Tests @@ -189,16 +200,21 @@ Test harness library There are a handful helper functions defined in the test harness library for your script to use. - test_expect_success <message> <script> + test_begin_subtest <message> + + Set the test description message for a subsequent test_expect_* + invocation (see below). + + test_expect_success <script> - This takes two strings as parameter, and evaluates the + This takes a string as parameter, and evaluates the <script>. If it yields success, test is considered - successful. <message> should state what it is testing. + successful. - test_begin_subtest <message> + test_expect_code <code> <script> - Set the test description message for a subsequent test_expect_equal - invocation (see below). + This takes two strings as parameter, and evaluates the <script>. + If it yields <code> exit status, test is considered successful. test_subtest_known_broken |
