summaryrefslogtreecommitdiff
path: root/test
AgeCommit message (Collapse)Author
2013-01-07test/tagging: add test for naked punctuation in tags; compare with quoting spaces.David Bremner
This test also serves as documentation of the quoting requirements. The comment lines are so that it exactly matches the man page. Nothing more embarrassing than having an example in the man page fail.
2013-01-07test/tagging: add test for exotic message-ids and batch taggingDavid Bremner
The (now fixed) bug that this test revealed is that unquoted message-ids with whitespace or other control characters in them are split into several tokens by the Xapian query parser.
2013-01-07test/tagging: add tests for exotic tagsDavid Bremner
We test quotes seperately because they matter to the query escaper.
2013-01-07test/tagging: add basic tests for batch tagging functionalityDavid Bremner
This tests argument parsing, blank lines and comments, and basic hex decoding functionality.
2013-01-07test/tagging: add test for error messages of tag --batchDavid Bremner
This is based on the similar test for notmuch restore, but the parser in batch tagging mode is less tolerant of a few cases, in particular those tested by illegal_tag.
2013-01-06emacs: Use the minibuffer for CLI error reportingAustin Clements
We recently switched to popping up a buffer to report CLI errors, but this was too intrusive, especially for transient errors and especially since we made fewer things ignore errors. This patch changes this to display a basic error message in the minibuffer (using Emacs' usual error handling path) and, if there are additional details, to log these to a separate error buffer and reference the error buffer from the minibuffer message. This is more in line with how Emacs typically handles errors, but makes the details available to the user without flooding them with the details. Given this split, we pare down the basic message and make it more user-friendly, and also make the verbose message even more detailed (and more debugging-oriented).
2013-01-06dump/restore: Use Xapian queries for batch-tag formatAustin Clements
This switches the new batch-tag format away from using a home-grown hex-encoding scheme for message IDs in the dump to simply using Xapian queries with Xapian quoting syntax. This has a variety of advantages beyond presenting a cleaner and more consistent interface. Foremost is that it will dramatically simplify the quoting for batch tagging, which shares the same input format. While the hex-encoding is no better or worse for the simple ID queries used by dump/restore, it becomes onerous for general-purpose queries used in batch tagging. It also better handles strange cases like "id:foo and bar", since this is no longer syntactically valid.
2013-01-06dump: Disallow \n in message IDsAustin Clements
When we switch to using regular Xapian queries in the dump format, \n will cause problems, so we disallow it. Specially, while Xapian can quote and parse queries containing \n without difficultly, quoted queries containing \n still span multiple lines, which breaks the line-orientedness of the dump format. Strictly speaking, we could still round-trip these, but it would significantly complicate restore as well as scripts that deal with tag dumps. This complexity would come at absolutely no benefit: because of the RFC 2822 unfolding rules, no amount of standards negligence can produce a message with a message ID containing a line break (not even Outlook can do it!). Hence, we simply disallow it.
2013-01-06notmuch-restore: handle empty input file, leading blank lines and comments.David Bremner
This patch corrects several undesirable behaviours: 1) Empty files were not detected, leading to buffer read overrun. 2) An initial blank line cause restore to silently abort 3) Initial comment line caused format detection to fail
2013-01-06test/dump-restore: new tests for empty files and leading comments/whitespace.David Bremner
Three of these are marked broken; the third is a regression test, since it passes by virtue of batch-tag being the default input format.
2012-12-18test: notmuch search --format=text0Jani Nikula
2012-12-17test: conform to content length, encoding fieldsPeter Wang
Update tests to expect content-length and content-transfer-encoding fields in show --format=json output, for leaf parts with omitted body content.
2012-12-17test: normalize only message filenames in show jsonPeter Wang
notmuch_json_show_sanitize replaced "filename" field values even in part structures, where the value is predictable. Make it only normalize the filename value if it is an absolute path (begins with slash), which is true of the Maildir filenames that were intended to be normalized away.
2012-12-16emacs: Use --format-version for search, show, and replyAustin Clements
2012-12-16test: Sanity tests for the --format-version argumentAustin Clements
2012-12-16test: Test search's handling of subprocess errorsAustin Clements
2012-12-16emacs: Use unified error handling in searchAustin Clements
This slightly changes the output of an existing test since we now report non-zero exits with a pop-up buffer instead of at the end of the search results.
2012-12-16test: Test show's handling of subprocess errorsAustin Clements
2012-12-11test: emacs: new tests "notmuch-show: {add,remove} multiple tags {to,from} single message"Pieter Praet
* test/emacs: - Rename subtests "{Add,Remove} tag from notmuch-show view" to "notmuch-show: {add,remove} single tag {to,from} single message" to be consistent with the following tests. - New subtest "notmuch-show: add multiple tags to single message": `notmuch-show-add-tag' ("+") can add multiple tags to a message. - New subtest "notmuch-show: remove multiple tags from single message": `notmuch-show-remove-tag' ("-") can remove multiple tags from a message.
2012-12-09test/dump-restore: add test for warning/error messagesDavid Bremner
We want to test both that error/warning messages are generated when they should be, and not generated when they should not be. This varies between restore and batch tagging.
2012-12-09test: second set of dump/restore --format=batch-tag testsDavid Bremner
These one need the completed functionality in notmuch-restore. Fairly exotic tags are tested, but no weird message id's. We test each possible input to autodetection, both explicit (with --format=auto) and implicit (without --format).
2012-12-09test: update dump-restore roundtripping test for batch-tag formatDavid Bremner
Now we can actually round trip these crazy tags and and message ids. hex-xcode is no longer needed as it's built in.
2012-12-08test: add sanity check for dump --format=batch-tag.David Bremner
It's important this does not rely on restore, since it hasn't been written yet.
2012-12-08Adding tests for --format=sexp.Peter Feigl
Add basic tests, the same as for json, for the S-Expression output format.
2012-12-08test: use perl instead of sed -r for portabilityJani Nikula
Our OS X users report -r is not a supported option for sed. Use perl instead.
2012-12-08test: wrap 'wc -l' results in arithmetic evaluation to strip whitespaceJani Nikula
This is for portability, as 'wc -l' emits whitespace on some BSD variants. Suggested by Tomi Ollila <tomi.ollila@iki.fi>.
2012-12-08test: fix count testJani Nikula
The quoting for ${SEARCH} is broken when it's supposed to be '*', and it seems tricky to get it right. Just drop the variable and use '*' directly. Before this, none of the messages ever matched, and the test was comparing zeros.
2012-12-08test: Fix UTF-8 JSON tests in Python 3Austin Clements
test_expect_equal_json uses json.tool from the system Python. While Python 2 wasn't picky about the encoding of stdin, Python 3 decodes stdin strictly according to the environment. Since we set LC_ALL=C for the tests, Python 3's json.tool was assuming stdin would be in ASCII and aborting when it couldn't decode the UTF-8 characters from some of the JSON tests. This patch sets the PYTHONIOENCODING environment variable to utf-8 when invoking json.tool to override Python's default encoding choice.
2012-12-06Changing build tool for test/random-corpus to CXX instead of CC.Peter Feigl
Without this change, GCC complains as follows: gcc test/random-corpus.o test/database-test.o notmuch-config.o command-line-arguments.o lib/libnotmuch.a util/libutil.a parse-time-string/libparse-time-string.a -o test/random-corpus -lgmime-2.6 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -Wl,-rpath,/usr/lib -ltalloc -lxapian /usr/bin/ld: lib/libnotmuch.a(database.o): undefined reference to symbol '_ZNSs4_Rep10_M_destroyERKSaIcE@@GLIBCXX_3.4' /usr/bin/ld: note: '_ZNSs4_Rep10_M_destroyERKSaIcE@@GLIBCXX_3.4' is defined in DSO /usr/lib/libstdc++.so.6 so try adding it to the linker command line /usr/lib/libstdc++.so.6: could not read symbols: Invalid operation collect2: error: ld returned 1 exit status make: *** [test/random-corpus] Error 1
2012-12-06Adding parse-time to test/.gitignorePeter Feigl
test/parse-time is a binary that is generated when running make test. It should be ignored by git.
2012-12-04test: fix an evident copy-paste error in argument parsing testJani Nikula
2012-12-02test: add broken roundtrip testDavid Bremner
We demonstrate the current notmuch restore parser being confused by message-id's and tags containing non alpha numeric characters (particularly space and parentheses are problematic because they are not escaped by notmuch dump). We save the files as hex escaped on disk so that terminal emulators will not get confused if the test fails (as we mostly expect it to do).
2012-12-02test: add generator for random "stub" messagesDavid Bremner
Initial use case is testing dump and restore, so we only have message-ids and tags. The message ID's are nothing like RFC compliant, but it doesn't seem any harder to roundtrip random UTF-8 strings than RFC-compliant ones. Tags are UTF-8, even though notmuch is in principle more generous than that. updated for id:m2wr04ocro.fsf@guru.guru-group.fi - talk about Unicode value rather some specific encoding - call talloc_realloc less times
2012-12-02test: add database routines for testingDavid Bremner
Initially, provide a way to create "stub" messages in the notmuch database without corresponding files. This is essentially cut and paste from lib/database.cc. This is a seperate file since we don't want to export these symbols from libnotmuch or bloat the library with non-exported code.
2012-12-02test/hex-escaping: new test for hex escaping routinesDavid Bremner
These are more like unit tests, to (try to) make sure the library functionality is working before building more complicated things on top of it.
2012-12-02test/hex-xcode: new test binaryDavid Bremner
This program is used both as a test-bed/unit-tester for ../util/hex-escape.c, and also as a utility in future tests of dump and restore.
2012-11-29test: Don't print 'nil' at the beginning of emacs-subject-to-filenameAustin Clements
2012-11-29test: Use associative arrays to track external prereqsAustin Clements
Previously, the test framework generated a variable name for each external prereq as a poor man's associative array. Unfortunately, prereqs names may not be legal variable names, leading to unintelligible bash errors like test_missing_external_prereq_emacsclient.emacs24_=t: command not found Using proper associative arrays to track prereqs, in addition to being much cleaner than generating variable names and using grep to carefully construct unique string lists, removes restrictions on prereq names.
2012-11-29test: Abort driver if a test script abortsAustin Clements
Previously, if a test script aborted (e.g., because it passed too few arguments to a test function), the test driver loop would simply continue on to the next test script and the final results would declare that everything passed (except that the test count would look suspiciously low, but maybe you just misremembered how many tests there were). Now, if a test script exits with a non-zero status and did not produce a final results file, we propagate that failure out of the driver loop immediately. To keep this simple, this patch removes the PID from the test-results file name. This PID was inherited from the git test system and seems unnecessary, since the file name already includes the name of the test script and the test-results directory is created anew for each run.
2012-11-29test: Make the emacsclient binary user-configurableAustin Clements
And require that if TEST_EMACS is specified, so is TEST_EMACSCLIENT. Previously, the test framework always used "emacsclient", even if the Emacs in use was overridden by TEST_EMACS. This causes problems if both Emacs 23 and Emacs 24 are installed, the Emacs 23 emacsclient is the system default, but TEST_EMACS is set to emacs24. Specifically, with an Emacs 24 server and an Emacs 23 client, emacs tests that run very quickly may produce no output from emacsclient, causing the test to fail. The Emacs server uses a very simple line-oriented protocol in which the client sends a request to evaluate an expression and the server sends a request to print the result of evaluation. Prior to Emacs bzr commit 107565 on March 11th, 2012 (released in Emacs 24.1), if multiple commands were sent to the emacsclient between when it sent the evaluation command and when it entered its receive loop, it would only process the first response command, ignoring the rest of the received buffer. This wasn't a problem with the Emacs 23 server because it sent only the command to print the evaluation result. However, the Emacs 24 server first sends an unprompted command specifying the PID of the Emacs server, then processes the evaluation request, then sends the command to print the result. If the evaluation is fast enough, it can send both of these commands before emacsclient enters the receive loop. Hence, if an Emacs 24 server is used with an Emacs 23 emacsclient, it may miss the response printing command, ultimately causing intermittent notmuch test failures.
2012-11-27test: Quote $output in calls to test_expect_equalAustin Clements
Previously, many tests in emacs-subject-to-filename didn't quote the $output argument to test_expect_equal. As a result, if $output was empty, test_expect_equal would be passed only one argument and would abort the entire test script. By quoting the argument, we ensure test_expect_equal will always receive two arguments.
2012-11-26new: Skip ignored broken symlinksAustin Clements
We now test for user ignore patterns before attempting to determine if a directory entry is itself a directory. As a result, we no longer abort for broken symlinks if the user has explicitly ignored them. This fixes the test added in the previous patch. It also slightly changes the debug output checked by another test of ignores.
2012-11-26test: Add a test for skipping ignored broken symlinksAustin Clements
Currently marked as broken because we abort on broken symlinks, even if they are in the ignore list.
2012-11-26emacs: less guessing of character set in messagesTomi Ollila
The macro with-current-notmuch-show-message executes command `notmuch show --format=raw id:...` which just outputs the contents of the mail file verbatim (into temporary buffer). In case e.g. utf-8 locale is used the temporary buffer has buffer-file-coding-system as utf-8. In this case Emacs converts the data to multibyte format, guessing that input is in utf-8. However, the "raw" (MIME) message may contain octet data in any other 8bit format, and as no (MIME-)content spesific handling to the message is done at this point, conversion to other formats may lose information. By setting coding-system-for-read 'no-conversion drops the conversion part and makes this handle input as notmuch-get-bodypart-internal() does. This marks the broken test in previous change fixed.
2012-11-26test/emacs: test saving of attachment containing 8bit octetsTomi Ollila
This test catches the case 8bit octets in an attachment gets converted or lost when saving attachment to the file. This test is marked known broken.
2012-11-26lib: Reject multi-message mboxes and deprecate single-message mboxAustin Clements
Previously, we would treat multi-message mboxes as one giant email, which, besides the obvious incorrect indexing, often led to out-of-memory errors for archival mboxes. Now we explicitly reject multi-message mboxes. For historical reasons, we retain support for single-message mboxes, but official deprecate this behavior.
2012-11-26test: Test for ignoring multi-message mboxAustin Clements
This test is currently broken. Note that its brokenness cascades and causes the next test to fail as well (because notmuch incorrectly indexes the mbox file).
2012-11-26test: Test notmuch new for single-message mboxAustin Clements
We support this for historical reasons.
2012-11-25test: factor out part of test-lib.sh into test-lib-common.shDavid Bremner
The idea is to use some of the simpler parts of the test suite infrastructure to help run performance tests.
2012-11-24test: always source test-lib.sh as ./test-lib.shTomi Ollila
There are currently 45 TESTS scripts. 36 of those load test-lib.sh using '. ./test-lib.sh' and 9 '. test-lib.sh'. In latter case test-lib.sh is first searched from directories in PATH (posix) and then from current directory (bash feature). Changed the 9 files to execute '. ./test-lib.sh'. The test-lib.sh should never be loaded from directory in PATH.