Commit graph

5765 commits

Author SHA1 Message Date
David Bremner
0a7181dd16 lib: calculate message depth in thread
This will be used in reparenting messages without useful in-reply-to,
but with useful references
2018-09-06 08:07:13 -03:00
David Bremner
a330858284 lib/thread: initial use of references as for fallback parenting
This is mainly to lay out the structure of the final code. The problem
isn't really solved yet, although some very simple cases are
better (hence the fixed test). We need two passes through the messages
because we need to be careful not to re-parent too many messages and
end up without any toplevel messages.
2018-09-06 08:07:13 -03:00
David Bremner
ac2146118b use EMPTY_STRING in _parent_via_in_reply_to
This is a review suggestion [1] of Tomi. I decided not to squash it
so that the code movement remains clear.

[1]: id:m2pnxxgf5q.fsf@guru.guru-group.fi
2018-09-06 08:07:13 -03:00
David Bremner
b9d4eb0412 lib/thread: refactor in_reply_to test
This is not a complete win in code-size, but it makes the code (which
is about to get more complicated) easier to follow.
2018-09-06 08:07:13 -03:00
David Bremner
dc3cc18bf0 lib: add _notmuch_message_list_empty
There is no public notmuch_message_list_t public interface, so to this
is added to the private API. We use it immediately in thread.cc;
future commits will use it further.
2018-09-06 08:07:13 -03:00
David Bremner
040fd630bf lib/thread: add macro for debug printing of threading
This is analogous to DEBUG_DATABASE_SANITY, and is intended to help
debugging and to help users submit bug reports.
2018-09-06 08:07:12 -03:00
David Bremner
d0b844b358 lib: read reference terms into message struct.
The plan is to use these in resolving threads.
2018-09-06 08:07:12 -03:00
David Bremner
9b568e73e1 lib/thread: sort sibling messages by date
For non-root messages, this should not should anything currently, as
the messages are already added in date order. In the future we will
add some non-root messages in a second pass out of order and the
sorting will be useful. It does fix the order of multiple
root-messages (although it is overkill for that).
2018-09-06 08:07:12 -03:00
David Bremner
ccb52edb4c test: add known broken tests for "ghost roots"
This documents the bug discussed at

     id:87efgmmysi.fsf@len.workgroup

The underlying issue is that the reply to a ghost (missing) message is
falsely classified as a root message in _resolve_thread_relationships.

There are two pairs of tests; in each case the the first test is
simpler / more robust, but also easier to fool.
2018-09-06 08:07:12 -03:00
David Bremner
ebd131ac07 test: start threading test corpus
There are 3 threads here, two synthetic, and one anonymized one using
data from Gregor. They test various aspects of thread
ordering/construction in the presence of replies to ghost messages.
2018-09-06 08:07:12 -03:00
David Bremner
dfda1745bf test/tag: add test for updating during batch tag operations
This clarifies that the breakage seen with Xapian 1.4.6 does not have
to do with "funny" tags.

This test is "known broken", but only with xapian 1.4.6, and there's
curently no convenient way to mark that.
2018-08-29 06:37:48 -03:00
Sebastian Poeplau
0f08bf7166 lib: detect mislabeled Windows-1252 parts
Use GMime functionality to detect mislabeled messages and apply the
correct (Windows) encoding instead.
2018-08-29 06:34:39 -03:00
Sebastian Poeplau
7074bb8f80 test: add known broken test for mislabeled Windows-1252 encoding
Messages that contain Windows-1252 are frequently mislabeled as ISO
8859-1, which may result in non-printable characters when displaying
the message. The test asserts that such characters (in this case
curved quotes) are displayed correctly.
2018-08-29 06:28:13 -03:00
David Edmondson
cfd015bda4 emacs: Kill the stderr buffer when an async process completes
On some platforms (e.g. macOS), it is necessary to add a real sentinel
process for the error buffer used by `notmuch-start-notmuch' rather
than a no-op sentinel.
2018-08-29 06:27:59 -03:00
Daniel Kahn Gillmor
fd3c93650d doc: clean up manpages
Many of the manpages didn't treat literal text as literal text.  I've
tried to normalize some of the restructured text to make it a bit more
regular.

several of the synopsis lines are still untouched by this cleanup, but
i'm not sure what the right way to represent those is in .rst,
actually.

In particular find that if i rebuild the manpages, sometimes i end up
with some of the synopsis lines showing – (U+2013 EN DASH) where they
should have -- (2 × U+002D HYPHEN-MINUS) in the generated nroff
output, though i have not tracked down the source of this error yet.
2018-06-24 21:59:37 -03:00
Daniel Kahn Gillmor
0741e48c3d use #!/usr/bin/env python consistently 2018-06-14 20:38:20 -03:00
Jameson Graef Rollins
0a3dff7b8a minor cleanup to printmimestructure
make the source slightly easier to read.  no functional change.
2018-06-14 20:36:19 -03:00
Daniel Kahn Gillmor
8ca911d13b devel: make printmimestructure py3 compatible
Make printmimestructure work in python3 as well as python2.
2018-06-14 20:33:17 -03:00
Tomi Ollila
ea36e70d7a minor post-0.26 NEWS layout fixes
As usual, one notices these *after* release(s).
2018-06-14 20:26:50 -03:00
David Bremner
b0b1fde0cb notmuch 0.27 release
-----BEGIN PGP SIGNATURE-----
 
 iQGzBAABCAAdFiEE3VS2dnyDRXKVCQCp8gKXHaSnniwFAlsg4j0ACgkQ8gKXHaSn
 niyYDQv/ZETykIyhoo2+Yi+om09PPo5EqanuCT28lHY33xCXbeeWX7p7tuPifeVP
 UXCvHnChbL/3aVnAx98kvydcT3n++3nfJBrXQ43SBRe8h3J26D9RpvXuga0xTMDA
 guCA/hTZiyOsSY8LqPwwFt/HuBLAR6Gu+mF0yTqwmeCZuSIXIDktrXdHXxBS3pVf
 AvNV5b3SUzEKl3pOlJrqJdRdL7+4215Z8plBeShQfOY2Ro+p1x3xEQr+qpBQzsWT
 Ye8yf3IEHM5OJtd5v5U7ROHseJpetow+IbQS5/vlK/+7BY3TWL64Z8I0nuV/RaRe
 uEdwpAOWuyVwLIih02eU19UMnGK0HsZriumWXRvgZBS0I1YmPvAiY8/g4O9M0eQn
 EOWDdFlYsL8vgUObo//JvLPTKg2nq3Ty9nXPVdPZXVyrM4dBA89Qz+N9JzMbtrPc
 A83xGRYZCoNOcGyfzSluL5iDV45jfEp9fGAikZvtdQhGowayrVpIlFwIxP0D4NC0
 h6901wud
 =j1wI
 -----END PGP SIGNATURE-----

Merge tag '0.27'

notmuch 0.27 release
2018-06-13 06:37:27 -03:00
David Bremner
079826f124 NEWS: set date 2018-06-12 22:42:34 -03:00
David Bremner
7174904529 debian: changelog for 0.27-1 2018-06-12 22:40:28 -03:00
David Bremner
b4303a1a72 version: bump to 0.27 2018-06-12 22:36:39 -03:00
Daniel Kahn Gillmor
af1adb3306 doc: document notmuch show --decrypt=stash
Help users find this new indexed-cleartext workflow.
2018-06-12 22:31:27 -03:00
David Bremner
e00e235e65 notmuch 0.27~rc1 release
-----BEGIN PGP SIGNATURE-----
 
 iQGzBAABCAAdFiEE3VS2dnyDRXKVCQCp8gKXHaSnniwFAlsSdpYACgkQ8gKXHaSn
 niwBbAwAi6dXzsjCNQHKaekCAjIHqzh0zzVBFrCTLskYElnyewcY/9aUWVHKYTgT
 FhhEkOTvcSOQ/OIEqBvDi2kML8qRg/RKfHvMewxuV88ugE5YjozsHfDxPsOlaqYR
 jMvX2TsnQhmXRYzlwEc485JILXlznNAphcl+ACc4Wis4jvi7L9hzjqNsAys+v7o1
 uX6QVTmDGXvjwzCM7IhSrNS+deYQJpqCkzpOXtebQUu8FwYMzmYStaqkxvf0f4Gg
 meQ1C1y7ei7qrApjm/LxhwczjaQFSanRACYDHBOUTEx83rn7sVgQvua9UG0Lh+/F
 7ZFhqva7D7unpSerWj5PZzTXie+AJp6geNh3eFGF/LxcTrrBOic6L+PTAefr74wX
 D33qCzAI1Av6lsuPbuBBOvoBf4gvhsyo7aiY2TQDWaCg+UMWukapJZTOpyiqOGCv
 99C5HCPi3l1CFYfG3bR91xq448aGTfJ9xedKhdAelLr5zEvsHnYblB5koxCstjLJ
 B4Xe/KiP
 =KT02
 -----END PGP SIGNATURE-----

Merge tag '0.27_rc1'

notmuch 0.27~rc1 release
2018-06-02 15:54:28 -03:00
David Bremner
db8602120a debian: changelog stanza for 0.27~rc1-1 2018-05-31 08:19:25 -03:00
David Bremner
98bdbae9f9 version: bump to 0.27~rc1 2018-05-31 08:17:12 -03:00
David Bremner
b71fa262b5 configure: check for links to/from libdir in ldconfig output
If e.g. /lib is a link to /usr/lib, then the latter may not show up in
the way we expect in the output of ldconfig. 'test foo -ef bar' checks
if foo and bar have the same device and inode numbers. Since (at least
in bash, dash, ksh, and zsh) the shell dereferences symlinks before
applying the test, this includes both the case where file1 is equal to
file2 and the case where one is a symlink to the other.
2018-05-31 08:14:47 -03:00
David Bremner
2f59498d69 NEWS: document installation of notmuch-emacs manual 2018-05-29 22:31:07 -03:00
David Bremner
a8c5256457 NEWS: mention notmuch --full-scan 2018-05-29 22:07:42 -03:00
David Bremner
fbf644d553 NEWS: mention thread:{} queries 2018-05-29 21:48:55 -03:00
David Bremner
460749d357 NEWS: deprecate pre-1.4.0 Xapian
We want to give people some heads up before dropping support, since
removing a bunch of ifdefs will be a pain to revert.
2018-05-29 20:57:37 -03:00
David Bremner
fd20a31e4c debian: update symbols for 0.27
add two new API symbols
2018-05-27 13:15:48 -07:00
David Bremner
cf68a0c257 NEWS: start entry for 0.27
No content yet.
2018-05-27 12:16:02 -07:00
David Bremner
46cf1a98f3 test: fix hardcoded paths in T050-new.sh
The previous paths will fail almost everywhere.
2018-05-26 16:46:44 -07:00
David Bremner
337b6cd790 debian: changelog for 0.27~rc0-1 2018-05-26 09:13:09 -07:00
David Bremner
c6225a00f5 bump version to 0.27~rc0
Start the busywork for a new release
2018-05-26 09:11:49 -07:00
David Bremner
b50fb1b642 docs: add initial documentation for notmuch-tag-jump
This is mainly to improve discoverability. It seems that doing
variable cross-references is not easy without using some sphinx
extension/customization.
2018-05-26 08:31:03 -07:00
David Bremner
7a58c1c44b doc: initial documentation for notmuch-tree mode 2018-05-26 08:29:35 -07:00
David Bremner
eb6fb36d63 doc: initial documentation for notmuch-show-mode
This is pretty minimal, but will hopefully inspire others to
contribute more complete documentation. If nothing else, it points out
'?'.
2018-05-26 08:28:18 -07:00
David Bremner
04a06063d4 debian: install info pages as part of elpa (emacs) package
This is a simple way to make the info pages available, since the emacs
package system deals with the annoying bits.  If there is many people
who want the info pages outside of emacs, we could consider a separate
binary package, but currently it doesn't seem worthwhile.
2018-05-26 08:27:19 -07:00
David Bremner
95f441b06b doc: install info files in elpa package
The duplication of effort in installing into different places seems
unavoidable; or more precisely not worth avoiding by more extensive
gnu-make-isms.
2018-05-26 08:26:22 -07:00
David Bremner
7a6d4a0852 doc: install build and install info pages
All of the man pages are installed as info pages, plus
the (unfinished) notmuch-emacs manual
2018-05-26 08:26:13 -07:00
David Bremner
7e3575c0ca configure: set 'infodir'
This turns --infodir from an ignored option into a real one
2018-05-26 08:26:02 -07:00
David Bremner
db666126cd configure: check for makeinfo and install-info
These are needed to build and install (respectively) the info format
documentation.
2018-05-26 08:25:51 -07:00
Daniel Kahn Gillmor
aa605f7e8a cli/show: enable --decrypt=stash
Add fancy new feature, which makes "notmuch show" capable of actually
indexing messages that it just decrypted.

This enables a workflow where messages can come in in the background
and be indexed using "--decrypt=auto".  But when showing an encrypted
message for the first time, it gets automatically indexed.

This is something of a departure for "notmuch show" -- in particular,
because it requires read/write access to the database.  However, this
might be a common use case -- people get mail delivered and indexed in
the background, but only want access to their secret key to happen
when they're directly interacting with notmuch itself.

In such a scenario, they couldn't search newly-delivered, encrypted
messages, but they could search for them once they've read them.

Documentation of this new feature also uses a table form, similar to
that found in the description of index.decrypt in notmuch-config(1).

A notmuch UI that wants to facilitate this workflow while also
offering an interactive search interface might instead make use of
these additional commands while the user is at the console:

Count received encrypted messages (if > 0, there are some things we
haven't yet tried to index, and therefore can't yet search):

     notmuch count tag:encrypted and \
         not property:index.decryption=success and \
         not property:index.decryption=failure

Reindex those messages:

     notmuch reindex --try-decrypt=true tag:encrypted and \
         not property:index.decryption=success and \
         not property:index.decryption=failure
2018-05-26 07:43:30 -07:00
Daniel Kahn Gillmor
9d114a8552 test-lib: add notmuch_show_part for "notmuch show --format=text"
Thanks to David Bremner for this improved readability!
2018-05-26 07:42:28 -07:00
Daniel Kahn Gillmor
808cababbb cli/show: reindex when we learned new session keys about a message
If the number of session keys for a given message increased after
running "notmuch show" then we just learned something new that might
let us do automatic decryption.  We should reindex this message using
our newfound knowledge.

Amended by db: add previously discussed #if block
2018-05-26 07:39:54 -07:00
Daniel Kahn Gillmor
bc842bfff1 cli: write session keys to database, if asked to do so
If the decryption policy is NOTMUCH_DECRYPT_TRUE, that means we want
to stash session keys in the database.  Note that there is currently
no way from the command line to set it this way, though, so it is not
yet included in the test suite.
2018-05-26 07:33:01 -07:00
Daniel Kahn Gillmor
f32e52448b cli: add print_status_message()
This function is a parallel to print_status_query() or
print_status_database().  Thanks to David Bremner for the suggestion!
2018-05-26 07:32:14 -07:00