notmuch/test/notmuch-test

#!/bin/sh

# Run tests
#
# Copyright (c) 2005 Junio C Hamano
#
# Adapted from a Makefile to a shell script by Carl Worth (2010)

cd $(dirname "$0")

TESTS="basic new search json thread-naming reply dump-restore uuencode thread-order author-order from-guessing long-id encoding"

# Clean up any results from a previous run
rm -r test-results >/dev/null 2>/dev/null

# Run the tests
for test in $TESTS; do
	./$test "$@"
done

# Report results
./aggregate-results.sh test-results/*

# Clean up
rm -r test-results corpus.mail
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile. 2010-09-17 21:10:54 +02:00			`#!/bin/sh`
Add a very rough beginning of a test suite. This notmuch-test script simply runs a few different notmuch operations, (things that I found were useful while testing the rename-support code). It's not useful as a test suite yet, since it doesn't actually check the results of any operation, (the user of the suite has to know what the results should be and must manually verify them. So there's no integration with the build system yet, (no "make test" target). But I didn't want to lose what I had so far, so here it is. 2010-01-23 19:36:39 +01:00
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile. 2010-09-17 21:10:54 +02:00			`# Run tests`
			`#`
			`# Copyright (c) 2005 Junio C Hamano`
			`#`
			`# Adapted from a Makefile to a shell script by Carl Worth (2010)`

			`cd $(dirname "$0")`

test: Print section names, and rename all test sections Now that we can usefully pass section names via the NOTMUCH_SKIP_TESTS environment variable, it's useful to actually print those names out for the user. Then, since we're now printing these names, let's use nicer names, (not excessively long but also not using abbreviations like "msg"). 2010-09-20 23:36:31 +02:00			`TESTS="basic new search json thread-naming reply dump-restore uuencode thread-order author-order from-guessing long-id encoding"`
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script. 2010-09-18 00:58:39 +02:00
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile. 2010-09-17 21:10:54 +02:00			`# Clean up any results from a previous run`
			`rm -r test-results >/dev/null 2>/dev/null`

			`# Run the tests`
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script. 2010-09-18 00:58:39 +02:00			`for test in $TESTS; do`
test: Fix notmuch-test to pass command-line arguments to sub-scripts. The is useful for things like "notmuch-test --valgrind", etc. 2010-09-20 22:45:29 +02:00			`./$test "$@"`
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile. 2010-09-17 21:10:54 +02:00			`done`

			`# Report results`
test: Rename all tests to get rid of the ugly numbers in file names. The numbers were meaningless, and they made it hard to find a file of interest. Instead, we get the ordering we want by adding an explicit list of tests to run to the notmuch-test script. 2010-09-18 00:58:39 +02:00			`./aggregate-results.sh test-results/*`
test: Fix test suite to integrate with our non-recursive Makefile system. This avoids "make test" emitting messages from three (3!) recursive invocations of make. We change the invocations of the tests themselves to occur directly from the shell script rather than having the shell script invoke make again and using wildcards in the Makefile. 2010-09-17 21:10:54 +02:00
			`# Clean up`
test: Fix the search and dump-restore tests to operator on non-empty mail store. We do this with a new add_email_corpus function that establishes a mail store with 50 messages from the notmuch mailing list. 2010-09-21 01:40:35 +02:00			`rm -r test-results corpus.mail`