debian/notmuch
1
0
Fork 0
mirror of https://git.notmuchmail.org/git/notmuch synced 2024-11-22 19:08:09 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
notmuch/test/notmuch-test

58 lines
1 KiB
Text
Raw Normal View History

test: Emit a friendly error message if run with bash < 4.0. The bash code in the test suite is using associative arrays which were only added to bash as of release 4.0. If the test suite is run with an older bash, we now immediately error out and explain the situation, (instead of emitting confusing error messages and failing dozens of tests, which is what happened before this change).
2010-10-28 21:07:42 +02:00
#!/bin/bash
Add a very rough beginning of a test suite. This notmuch-test script simply runs a few different notmuch operations, (things that I found were useful while testing the rename-support code). It's not useful as a test suite yet, since it doesn't actually check the results of any operation, (the user of the suite has to know what the results should be and must manually verify them. So there's no integration with the build system yet, (no "make test" target). But I didn't want to lose what I had so far, so here it is.
2010-01-23 19:36:39 +01:00
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
# Run tests
#
# Copyright (c) 2005 Junio C Hamano
#
# Adapted from a Makefile to a shell script by Carl Worth (2010)
test: Emit a friendly error message if run with bash < 4.0. The bash code in the test suite is using associative arrays which were only added to bash as of release 4.0. If the test suite is run with an older bash, we now immediately error out and explain the situation, (instead of emitting confusing error messages and failing dozens of tests, which is what happened before this change).
2010-10-28 21:07:42 +02:00
if [ ${BASH_VERSINFO[0]} -lt 4 ]; then
echo "Error: The notmuch test suite requires a bash version >= 4.0"
echo "due to use of associative arrays within the test suite."
echo "Please try again with a newer bash (or help us fix the"
echo "test suite to be more portable). Thanks."
exit 1
fi
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
cd $(dirname "$0")
test: Make it easier to resolve conflicts when adding new tests Currently, there are two places in the test framework that contain very long list on a single line. Whenever a test is added (or changed) in several branches and these branches are merged, it results in conflict which is hard to resolve because one has to go through the whole long line to find where the conflict is. This patch splits these long lists to several lines so that the conflicts are easier to resolve.
2011-01-23 12:12:24 +01:00
TESTS="
basic
new
search
search-output
search-by-folder
search-position-overlap-bug
test: Rename and clarify the search-lwn test Now that we understand the bug here, we rename this test to search-insufficient-from-quoting to clarify the bug being exercised, (which occurs when the From: line contains an unquoted '.' character). We also mark these tests as expected failures until the bug gets fixed.
2011-01-28 21:21:25 +01:00
search-insufficient-from-quoting
test: Make it easier to resolve conflicts when adding new tests Currently, there are two places in the test framework that contain very long list on a single line. Whenever a test is added (or changed) in several branches and these branches are merged, it results in conflict which is hard to resolve because one has to go through the whole long line to find where the conflict is. This patch splits these long lists to several lines so that the conflicts are easier to resolve.
2011-01-23 12:12:24 +01:00
json
test: Add a test of "notmuch show" with a multipart message This tests "notmuch show" with both --format=text and --format=json on a message with some non-trivial MIME multipart nesting, (multiple parts within a multipart/mixed part which is within a multipart/signed part). The test captures the current behavior (where only the leaf nodes of the MIME structure are emitted as a flat list---the multipart parts are effectively ignored). We plan to soon change the json output at least to emit an actual hierarchy matching the MIME structure, (at which point we will update this test).
2011-05-17 00:25:25 +02:00
multipart
test: Make it easier to resolve conflicts when adding new tests Currently, there are two places in the test framework that contain very long list on a single line. Whenever a test is added (or changed) in several branches and these branches are merged, it results in conflict which is hard to resolve because one has to go through the whole long line to find where the conflict is. This patch splits these long lists to several lines so that the conflicts are easier to resolve.
2011-01-23 12:12:24 +01:00
thread-naming
raw
reply
dump-restore
uuencode
thread-order
author-order
from-guessing
long-id
encoding
emacs
Rename/rewrite the new emacs-forgetfulness test (to emacs-large-search-buffer) The new name is more descriptive of the bug being tested. Also, the test is rewritten slightly so that it's much more plain to see how the bug manifests itself, (that messages are droped from the emacs result at regular intervals). Primarily, this is by collapsing the large blobs used to inflate the message subjects.
2011-03-10 22:22:04 +01:00
emacs-large-search-buffer
test: Make it easier to resolve conflicts when adding new tests Currently, there are two places in the test framework that contain very long list on a single line. Whenever a test is added (or changed) in several branches and these branches are merged, it results in conflict which is hard to resolve because one has to go through the whole long line to find where the conflict is. This patch splits these long lists to several lines so that the conflicts are easier to resolve.
2011-01-23 12:12:24 +01:00
maildir-sync
"
test: allow specifying tests to run with NOTMUCH_TESTS env var This is useful for just running a specific subset of tests, ie: NOTMUCH_TESTS=crypto make test
2011-05-07 21:08:34 +02:00
TESTS=${NOTMUCH_TESTS:=$TESTS}
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script.
2010-09-18 00:58:39 +02:00
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
# Clean up any results from a previous run
Revert "test: Break on test script (or other) error" This reverts commit f22a7ec1e28d1264cf9d67d78796b8ab22e09a35. Interrupting the test suite due to an actual bug in a test script would be just fine, but interrupting the run of the entire test suite at the first test failure is unacceptable.
2010-12-08 00:28:44 +01:00
rm -r test-results >/dev/null 2>/dev/null
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
# Run the tests
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script.
2010-09-18 00:58:39 +02:00
for test in $TESTS; do
test: Fix notmuch-test to pass command-line arguments to sub-scripts. The is useful for things like "notmuch-test --valgrind", etc.
2010-09-20 22:45:29 +02:00
./$test "$@"
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
done
# Report results
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script.
2010-09-18 00:58:39 +02:00
./aggregate-results.sh test-results/*
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile.
2010-09-17 21:10:54 +02:00
# Clean up
test: force deletion of test remnants This keeps the test from failing if only a subset of the remnants were available for deletion, because e.g. only a subset of the tests were run.
2011-05-07 21:10:04 +02:00
rm -rf test-results corpus.mail
Reference in a new issue Copy permalink