aboutsummaryrefslogtreecommitdiff
path: root/test
AgeCommit message (Collapse)Author
2012-12-16emacs: Use --format-version for search, show, and replyAustin Clements
2012-12-16test: Sanity tests for the --format-version argumentAustin Clements
2012-12-16test: Test search's handling of subprocess errorsAustin Clements
2012-12-16emacs: Use unified error handling in searchAustin Clements
This slightly changes the output of an existing test since we now report non-zero exits with a pop-up buffer instead of at the end of the search results.
2012-12-16test: Test show's handling of subprocess errorsAustin Clements
2012-12-11test: emacs: new tests "notmuch-show: {add,remove} multiple tags {to,from} single message"Pieter Praet
* test/emacs: - Rename subtests "{Add,Remove} tag from notmuch-show view" to "notmuch-show: {add,remove} single tag {to,from} single message" to be consistent with the following tests. - New subtest "notmuch-show: add multiple tags to single message": `notmuch-show-add-tag' ("+") can add multiple tags to a message. - New subtest "notmuch-show: remove multiple tags from single message": `notmuch-show-remove-tag' ("-") can remove multiple tags from a message.
2012-12-09test/dump-restore: add test for warning/error messagesDavid Bremner
We want to test both that error/warning messages are generated when they should be, and not generated when they should not be. This varies between restore and batch tagging.
2012-12-09test: second set of dump/restore --format=batch-tag testsDavid Bremner
These one need the completed functionality in notmuch-restore. Fairly exotic tags are tested, but no weird message id's. We test each possible input to autodetection, both explicit (with --format=auto) and implicit (without --format).
2012-12-09test: update dump-restore roundtripping test for batch-tag formatDavid Bremner
Now we can actually round trip these crazy tags and and message ids. hex-xcode is no longer needed as it's built in.
2012-12-08test: add sanity check for dump --format=batch-tag.David Bremner
It's important this does not rely on restore, since it hasn't been written yet.
2012-12-08Adding tests for --format=sexp.Peter Feigl
Add basic tests, the same as for json, for the S-Expression output format.
2012-12-08test: use perl instead of sed -r for portabilityJani Nikula
Our OS X users report -r is not a supported option for sed. Use perl instead.
2012-12-08test: wrap 'wc -l' results in arithmetic evaluation to strip whitespaceJani Nikula
This is for portability, as 'wc -l' emits whitespace on some BSD variants. Suggested by Tomi Ollila <tomi.ollila@iki.fi>.
2012-12-08test: fix count testJani Nikula
The quoting for ${SEARCH} is broken when it's supposed to be '*', and it seems tricky to get it right. Just drop the variable and use '*' directly. Before this, none of the messages ever matched, and the test was comparing zeros.
2012-12-08test: Fix UTF-8 JSON tests in Python 3Austin Clements
test_expect_equal_json uses json.tool from the system Python. While Python 2 wasn't picky about the encoding of stdin, Python 3 decodes stdin strictly according to the environment. Since we set LC_ALL=C for the tests, Python 3's json.tool was assuming stdin would be in ASCII and aborting when it couldn't decode the UTF-8 characters from some of the JSON tests. This patch sets the PYTHONIOENCODING environment variable to utf-8 when invoking json.tool to override Python's default encoding choice.
2012-12-06Changing build tool for test/random-corpus to CXX instead of CC.Peter Feigl
Without this change, GCC complains as follows: gcc test/random-corpus.o test/database-test.o notmuch-config.o command-line-arguments.o lib/libnotmuch.a util/libutil.a parse-time-string/libparse-time-string.a -o test/random-corpus -lgmime-2.6 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -Wl,-rpath,/usr/lib -ltalloc -lxapian /usr/bin/ld: lib/libnotmuch.a(database.o): undefined reference to symbol '_ZNSs4_Rep10_M_destroyERKSaIcE@@GLIBCXX_3.4' /usr/bin/ld: note: '_ZNSs4_Rep10_M_destroyERKSaIcE@@GLIBCXX_3.4' is defined in DSO /usr/lib/libstdc++.so.6 so try adding it to the linker command line /usr/lib/libstdc++.so.6: could not read symbols: Invalid operation collect2: error: ld returned 1 exit status make: *** [test/random-corpus] Error 1
2012-12-06Adding parse-time to test/.gitignorePeter Feigl
test/parse-time is a binary that is generated when running make test. It should be ignored by git.
2012-12-04test: fix an evident copy-paste error in argument parsing testJani Nikula
2012-12-02test: add broken roundtrip testDavid Bremner
We demonstrate the current notmuch restore parser being confused by message-id's and tags containing non alpha numeric characters (particularly space and parentheses are problematic because they are not escaped by notmuch dump). We save the files as hex escaped on disk so that terminal emulators will not get confused if the test fails (as we mostly expect it to do).
2012-12-02test: add generator for random "stub" messagesDavid Bremner
Initial use case is testing dump and restore, so we only have message-ids and tags. The message ID's are nothing like RFC compliant, but it doesn't seem any harder to roundtrip random UTF-8 strings than RFC-compliant ones. Tags are UTF-8, even though notmuch is in principle more generous than that. updated for id:m2wr04ocro.fsf@guru.guru-group.fi - talk about Unicode value rather some specific encoding - call talloc_realloc less times
2012-12-02test: add database routines for testingDavid Bremner
Initially, provide a way to create "stub" messages in the notmuch database without corresponding files. This is essentially cut and paste from lib/database.cc. This is a seperate file since we don't want to export these symbols from libnotmuch or bloat the library with non-exported code.
2012-12-02test/hex-escaping: new test for hex escaping routinesDavid Bremner
These are more like unit tests, to (try to) make sure the library functionality is working before building more complicated things on top of it.
2012-12-02test/hex-xcode: new test binaryDavid Bremner
This program is used both as a test-bed/unit-tester for ../util/hex-escape.c, and also as a utility in future tests of dump and restore.
2012-11-29test: Don't print 'nil' at the beginning of emacs-subject-to-filenameAustin Clements
2012-11-29test: Use associative arrays to track external prereqsAustin Clements
Previously, the test framework generated a variable name for each external prereq as a poor man's associative array. Unfortunately, prereqs names may not be legal variable names, leading to unintelligible bash errors like test_missing_external_prereq_emacsclient.emacs24_=t: command not found Using proper associative arrays to track prereqs, in addition to being much cleaner than generating variable names and using grep to carefully construct unique string lists, removes restrictions on prereq names.
2012-11-29test: Abort driver if a test script abortsAustin Clements
Previously, if a test script aborted (e.g., because it passed too few arguments to a test function), the test driver loop would simply continue on to the next test script and the final results would declare that everything passed (except that the test count would look suspiciously low, but maybe you just misremembered how many tests there were). Now, if a test script exits with a non-zero status and did not produce a final results file, we propagate that failure out of the driver loop immediately. To keep this simple, this patch removes the PID from the test-results file name. This PID was inherited from the git test system and seems unnecessary, since the file name already includes the name of the test script and the test-results directory is created anew for each run.
2012-11-29test: Make the emacsclient binary user-configurableAustin Clements
And require that if TEST_EMACS is specified, so is TEST_EMACSCLIENT. Previously, the test framework always used "emacsclient", even if the Emacs in use was overridden by TEST_EMACS. This causes problems if both Emacs 23 and Emacs 24 are installed, the Emacs 23 emacsclient is the system default, but TEST_EMACS is set to emacs24. Specifically, with an Emacs 24 server and an Emacs 23 client, emacs tests that run very quickly may produce no output from emacsclient, causing the test to fail. The Emacs server uses a very simple line-oriented protocol in which the client sends a request to evaluate an expression and the server sends a request to print the result of evaluation. Prior to Emacs bzr commit 107565 on March 11th, 2012 (released in Emacs 24.1), if multiple commands were sent to the emacsclient between when it sent the evaluation command and when it entered its receive loop, it would only process the first response command, ignoring the rest of the received buffer. This wasn't a problem with the Emacs 23 server because it sent only the command to print the evaluation result. However, the Emacs 24 server first sends an unprompted command specifying the PID of the Emacs server, then processes the evaluation request, then sends the command to print the result. If the evaluation is fast enough, it can send both of these commands before emacsclient enters the receive loop. Hence, if an Emacs 24 server is used with an Emacs 23 emacsclient, it may miss the response printing command, ultimately causing intermittent notmuch test failures.
2012-11-27test: Quote $output in calls to test_expect_equalAustin Clements
Previously, many tests in emacs-subject-to-filename didn't quote the $output argument to test_expect_equal. As a result, if $output was empty, test_expect_equal would be passed only one argument and would abort the entire test script. By quoting the argument, we ensure test_expect_equal will always receive two arguments.
2012-11-26new: Skip ignored broken symlinksAustin Clements
We now test for user ignore patterns before attempting to determine if a directory entry is itself a directory. As a result, we no longer abort for broken symlinks if the user has explicitly ignored them. This fixes the test added in the previous patch. It also slightly changes the debug output checked by another test of ignores.
2012-11-26test: Add a test for skipping ignored broken symlinksAustin Clements
Currently marked as broken because we abort on broken symlinks, even if they are in the ignore list.
2012-11-26emacs: less guessing of character set in messagesTomi Ollila
The macro with-current-notmuch-show-message executes command `notmuch show --format=raw id:...` which just outputs the contents of the mail file verbatim (into temporary buffer). In case e.g. utf-8 locale is used the temporary buffer has buffer-file-coding-system as utf-8. In this case Emacs converts the data to multibyte format, guessing that input is in utf-8. However, the "raw" (MIME) message may contain octet data in any other 8bit format, and as no (MIME-)content spesific handling to the message is done at this point, conversion to other formats may lose information. By setting coding-system-for-read 'no-conversion drops the conversion part and makes this handle input as notmuch-get-bodypart-internal() does. This marks the broken test in previous change fixed.
2012-11-26test/emacs: test saving of attachment containing 8bit octetsTomi Ollila
This test catches the case 8bit octets in an attachment gets converted or lost when saving attachment to the file. This test is marked known broken.
2012-11-26lib: Reject multi-message mboxes and deprecate single-message mboxAustin Clements
Previously, we would treat multi-message mboxes as one giant email, which, besides the obvious incorrect indexing, often led to out-of-memory errors for archival mboxes. Now we explicitly reject multi-message mboxes. For historical reasons, we retain support for single-message mboxes, but official deprecate this behavior.
2012-11-26test: Test for ignoring multi-message mboxAustin Clements
This test is currently broken. Note that its brokenness cascades and causes the next test to fail as well (because notmuch incorrectly indexes the mbox file).
2012-11-26test: Test notmuch new for single-message mboxAustin Clements
We support this for historical reasons.
2012-11-25test: factor out part of test-lib.sh into test-lib-common.shDavid Bremner
The idea is to use some of the simpler parts of the test suite infrastructure to help run performance tests.
2012-11-24test: always source test-lib.sh as ./test-lib.shTomi Ollila
There are currently 45 TESTS scripts. 36 of those load test-lib.sh using '. ./test-lib.sh' and 9 '. test-lib.sh'. In latter case test-lib.sh is first searched from directories in PATH (posix) and then from current directory (bash feature). Changed the 9 files to execute '. ./test-lib.sh'. The test-lib.sh should never be loaded from directory in PATH.
2012-11-21test: Produce useful output when the HTML with images test failsAustin Clements
Previously, this would simply indicate that the grep failed without any indication of the Emacs output it failed on. Now we take advantage of the test framework's handling of stdout to display the incorrect Emacs output if the test fails.
2012-11-17test: add nontrivial test for restore --accumulate.David Bremner
It seems we have never tested the case that restore --accumulate actually adds tags. I noticed this when I started optimizing and no tests failed. The bracketing with "restore --input=dump.expected" are to make sure we start in a known state, and we leave the database in a known state for the next test.
2012-11-17test: add more informative titles to restore --accumulate testsDavid Bremner
Thanks to Ethan for the suggestion.
2012-11-16Fixed 2 misspellings of word 'separate'Tomi Ollila
"Seperate: The second most common misspelling on the Internet..." (from http://www.re-vision.com/spelling/separate.html). s/seperate/separate/ in debian/NEWS.Debian & test/README done.
2012-11-15test: Fix HTML rendering testAustin Clements
The test designed to exercise Emacs' rendering of HTML emails containing images inadvertently assumed w3m was available under Emacs 23. The real point of this test was to check that Emacs 24's shr renderer didn't crash when given img tags, so use shr if it's available, html2text otherwise (which is built in), and do only a simple sanity check of the result.
2012-11-15emacs: Buttonize mid: linksAustin Clements
This adds support for RFC 2392 mid: message ID links.
2012-11-15emacs: Improve the regexp used to match id:'s in messagesAustin Clements
This regexp agrees with Xapian query syntax much more closely, though we specifically disallow various cases that would be confusing in the context of an email body (e.g., punctuation at the end of an id: link is not considered part of the id: link because it's probably part of the surrounding text). In particular, this handles id: links that are not surrounded by quotes much better, which stash is much more likely to generate now that we don't quote id's that don't need to be quoted. It also handles quoted id: links better. We update the buttonization test to reflect the new pattern.
2012-11-15test: Test buttonization of id: linksAustin Clements
This matches the current behavior of the buttonizer, so it passes, but many of these cases are not what you'd want (and some of them aren't even valid Xapian queries). The next patch will fix the handling of these cases and update the test.
2012-11-10test: expand regex in test/basicDavid Bremner
Over time, maintaining this very long regex has become irritating, especially when resolving conflicts. This patch replaces the call to sed with multiple extra arguments to find. Since each test binary is now on it's own line, this should make resolving conflicts easier.
2012-11-07test: add test for showing Reply-To headersPeter Wang
Test that show --format=json now outputs Reply-To header fields when present.
2012-10-31test: add tests for date:since..until range queriesJani Nikula
A brief initial test set.
2012-10-31test: add smoke tests for the date/time parser moduleJani Nikula
Test the date/time parser module directly, independent of notmuch, using the parse-time test tool. Credits to Michal Sojka <sojkam1@fel.cvut.cz> for writing most of the tests.
2012-10-31test: add new test tool parse-time for date/time parserJani Nikula
Add a smoke testing tool to support testing the date/time parser module directly and independent of the rest of notmuch. Credits to Michal Sojka <sojkam1@fel.cvut.cz> for the stdin parsing idea and consequent massive improvement in testability.