Commit graph

5827 commits

Author SHA1 Message Date
David Bremner
87934c432c lib: change parent strategy to use In-Reply-To if it looks sane
As reported by Sean Whitton, there are mailers (in particular the
Debian Bug Tracking System) that have sensible In-Reply-To headers,
but un-useful-for-notmuch References (in particular with the BTS, the
oldest reference is last). I looked at a sample of about 200K
messages, and only about 0.5% these had something other than a single
message-id in In-Reply-To. On this basis, if we see a single
message-id in In-Reply-To, consider that as authoritative.
2018-09-06 08:07:13 -03:00
David Bremner
b31e44c678 lib: add _notmuch_message_id_parse_strict
The idea is that if a message-id parses with this function, the MUA
generating it was probably sane, and in particular it's probably safe
to use the result as a parent from In-Reply-to.
2018-09-06 08:07:13 -03:00
David Bremner
b8e6f042c5 util/string-util: export skip_space
It's only few lines, but we already define the function, so make it
usable elsewhere
2018-09-06 08:07:13 -03:00
David Bremner
35053c2b9a test/thread-replies: mangle In-Reply-To's
In a future commit, we will start trusting In-Reply-To's when they
look sane (i.e. a single message-id). Modify these tests so they will
keep passing (i.e. keep choosing References) when that happens.
2018-09-06 08:07:13 -03:00
David Bremner
ea08032ae4 test: add known broken test for good In-Reply-To / bad References
The current scheme of choosing the replyto (i.e. the default parent
for threading purposes) does not work well for mailers that put
the oldest Reference last.
2018-09-06 08:07:13 -03:00
David Bremner
46dce33abc lib/thread: change _resolve_thread_relationships to use depths
We (finally) implement the XXX comment. It requires a bit of care not
to reparent all of the possible toplevel messages.

_notmuch_messages_has_next is not ready to be a public function yet,
since it punts on the mset case. We know in the one case it is called,
the notmuch_messages_t is just a regular list / iterator.
2018-09-06 08:07:13 -03:00
David Bremner
21803df6ae lib/thread: rewrite _parent_or_toplevel to use depths
This is part 1/2 of changing the reparenting of alleged toplevel
messages to use a "deep" reference rather than just the first one
found.
2018-09-06 08:07:13 -03:00
David Bremner
0a7181dd16 lib: calculate message depth in thread
This will be used in reparenting messages without useful in-reply-to,
but with useful references
2018-09-06 08:07:13 -03:00
David Bremner
a330858284 lib/thread: initial use of references as for fallback parenting
This is mainly to lay out the structure of the final code. The problem
isn't really solved yet, although some very simple cases are
better (hence the fixed test). We need two passes through the messages
because we need to be careful not to re-parent too many messages and
end up without any toplevel messages.
2018-09-06 08:07:13 -03:00
David Bremner
ac2146118b use EMPTY_STRING in _parent_via_in_reply_to
This is a review suggestion [1] of Tomi. I decided not to squash it
so that the code movement remains clear.

[1]: id:m2pnxxgf5q.fsf@guru.guru-group.fi
2018-09-06 08:07:13 -03:00
David Bremner
b9d4eb0412 lib/thread: refactor in_reply_to test
This is not a complete win in code-size, but it makes the code (which
is about to get more complicated) easier to follow.
2018-09-06 08:07:13 -03:00
David Bremner
dc3cc18bf0 lib: add _notmuch_message_list_empty
There is no public notmuch_message_list_t public interface, so to this
is added to the private API. We use it immediately in thread.cc;
future commits will use it further.
2018-09-06 08:07:13 -03:00
David Bremner
040fd630bf lib/thread: add macro for debug printing of threading
This is analogous to DEBUG_DATABASE_SANITY, and is intended to help
debugging and to help users submit bug reports.
2018-09-06 08:07:12 -03:00
David Bremner
d0b844b358 lib: read reference terms into message struct.
The plan is to use these in resolving threads.
2018-09-06 08:07:12 -03:00
David Bremner
9b568e73e1 lib/thread: sort sibling messages by date
For non-root messages, this should not should anything currently, as
the messages are already added in date order. In the future we will
add some non-root messages in a second pass out of order and the
sorting will be useful. It does fix the order of multiple
root-messages (although it is overkill for that).
2018-09-06 08:07:12 -03:00
David Bremner
ccb52edb4c test: add known broken tests for "ghost roots"
This documents the bug discussed at

     id:87efgmmysi.fsf@len.workgroup

The underlying issue is that the reply to a ghost (missing) message is
falsely classified as a root message in _resolve_thread_relationships.

There are two pairs of tests; in each case the the first test is
simpler / more robust, but also easier to fool.
2018-09-06 08:07:12 -03:00
David Bremner
ebd131ac07 test: start threading test corpus
There are 3 threads here, two synthetic, and one anonymized one using
data from Gregor. They test various aspects of thread
ordering/construction in the presence of replies to ghost messages.
2018-09-06 08:07:12 -03:00
David Bremner
dfda1745bf test/tag: add test for updating during batch tag operations
This clarifies that the breakage seen with Xapian 1.4.6 does not have
to do with "funny" tags.

This test is "known broken", but only with xapian 1.4.6, and there's
curently no convenient way to mark that.
2018-08-29 06:37:48 -03:00
Sebastian Poeplau
0f08bf7166 lib: detect mislabeled Windows-1252 parts
Use GMime functionality to detect mislabeled messages and apply the
correct (Windows) encoding instead.
2018-08-29 06:34:39 -03:00
Sebastian Poeplau
7074bb8f80 test: add known broken test for mislabeled Windows-1252 encoding
Messages that contain Windows-1252 are frequently mislabeled as ISO
8859-1, which may result in non-printable characters when displaying
the message. The test asserts that such characters (in this case
curved quotes) are displayed correctly.
2018-08-29 06:28:13 -03:00
David Edmondson
cfd015bda4 emacs: Kill the stderr buffer when an async process completes
On some platforms (e.g. macOS), it is necessary to add a real sentinel
process for the error buffer used by `notmuch-start-notmuch' rather
than a no-op sentinel.
2018-08-29 06:27:59 -03:00
David Bremner
9b1d10490e debian: changelog for 0.27-2 2018-06-28 21:07:31 -03:00
David Bremner
2f4beda434 notmuch (0.27-2) unstable; urgency=medium
* Add texinfo as a build-dep, build info version of documentation.

[dgit import unpatched notmuch 0.27-2]
2018-06-28 21:01:29 -03:00
David Bremner
d12a4f4a82 Import notmuch_0.27-2.debian.tar.xz
[dgit import tarball notmuch 0.27-2 notmuch_0.27-2.debian.tar.xz]
2018-06-28 21:01:29 -03:00
David Bremner
8964fad030 debian: add build depency on texinfo
This is needed to provide a makeinfo binary, to build the info version
of the documentation.
2018-06-28 20:58:04 -03:00
Daniel Kahn Gillmor
fd3c93650d doc: clean up manpages
Many of the manpages didn't treat literal text as literal text.  I've
tried to normalize some of the restructured text to make it a bit more
regular.

several of the synopsis lines are still untouched by this cleanup, but
i'm not sure what the right way to represent those is in .rst,
actually.

In particular find that if i rebuild the manpages, sometimes i end up
with some of the synopsis lines showing – (U+2013 EN DASH) where they
should have -- (2 × U+002D HYPHEN-MINUS) in the generated nroff
output, though i have not tracked down the source of this error yet.
2018-06-24 21:59:37 -03:00
Daniel Kahn Gillmor
0741e48c3d use #!/usr/bin/env python consistently 2018-06-14 20:38:20 -03:00
Jameson Graef Rollins
0a3dff7b8a minor cleanup to printmimestructure
make the source slightly easier to read.  no functional change.
2018-06-14 20:36:19 -03:00
Daniel Kahn Gillmor
8ca911d13b devel: make printmimestructure py3 compatible
Make printmimestructure work in python3 as well as python2.
2018-06-14 20:33:17 -03:00
Tomi Ollila
ea36e70d7a minor post-0.26 NEWS layout fixes
As usual, one notices these *after* release(s).
2018-06-14 20:26:50 -03:00
David Bremner
b0b1fde0cb notmuch 0.27 release
-----BEGIN PGP SIGNATURE-----
 
 iQGzBAABCAAdFiEE3VS2dnyDRXKVCQCp8gKXHaSnniwFAlsg4j0ACgkQ8gKXHaSn
 niyYDQv/ZETykIyhoo2+Yi+om09PPo5EqanuCT28lHY33xCXbeeWX7p7tuPifeVP
 UXCvHnChbL/3aVnAx98kvydcT3n++3nfJBrXQ43SBRe8h3J26D9RpvXuga0xTMDA
 guCA/hTZiyOsSY8LqPwwFt/HuBLAR6Gu+mF0yTqwmeCZuSIXIDktrXdHXxBS3pVf
 AvNV5b3SUzEKl3pOlJrqJdRdL7+4215Z8plBeShQfOY2Ro+p1x3xEQr+qpBQzsWT
 Ye8yf3IEHM5OJtd5v5U7ROHseJpetow+IbQS5/vlK/+7BY3TWL64Z8I0nuV/RaRe
 uEdwpAOWuyVwLIih02eU19UMnGK0HsZriumWXRvgZBS0I1YmPvAiY8/g4O9M0eQn
 EOWDdFlYsL8vgUObo//JvLPTKg2nq3Ty9nXPVdPZXVyrM4dBA89Qz+N9JzMbtrPc
 A83xGRYZCoNOcGyfzSluL5iDV45jfEp9fGAikZvtdQhGowayrVpIlFwIxP0D4NC0
 h6901wud
 =j1wI
 -----END PGP SIGNATURE-----

Merge tag '0.27'

notmuch 0.27 release
2018-06-13 06:37:27 -03:00
David Bremner
079826f124 NEWS: set date 2018-06-12 22:42:34 -03:00
David Bremner
7174904529 debian: changelog for 0.27-1 2018-06-12 22:40:28 -03:00
David Bremner
045f0e455a Import notmuch_0.27.orig.tar.gz
[dgit import orig notmuch_0.27.orig.tar.gz]
2018-06-12 22:39:33 -03:00
David Bremner
b4303a1a72 version: bump to 0.27 2018-06-12 22:36:39 -03:00
Daniel Kahn Gillmor
af1adb3306 doc: document notmuch show --decrypt=stash
Help users find this new indexed-cleartext workflow.
2018-06-12 22:31:27 -03:00
David Bremner
e00e235e65 notmuch 0.27~rc1 release
-----BEGIN PGP SIGNATURE-----
 
 iQGzBAABCAAdFiEE3VS2dnyDRXKVCQCp8gKXHaSnniwFAlsSdpYACgkQ8gKXHaSn
 niwBbAwAi6dXzsjCNQHKaekCAjIHqzh0zzVBFrCTLskYElnyewcY/9aUWVHKYTgT
 FhhEkOTvcSOQ/OIEqBvDi2kML8qRg/RKfHvMewxuV88ugE5YjozsHfDxPsOlaqYR
 jMvX2TsnQhmXRYzlwEc485JILXlznNAphcl+ACc4Wis4jvi7L9hzjqNsAys+v7o1
 uX6QVTmDGXvjwzCM7IhSrNS+deYQJpqCkzpOXtebQUu8FwYMzmYStaqkxvf0f4Gg
 meQ1C1y7ei7qrApjm/LxhwczjaQFSanRACYDHBOUTEx83rn7sVgQvua9UG0Lh+/F
 7ZFhqva7D7unpSerWj5PZzTXie+AJp6geNh3eFGF/LxcTrrBOic6L+PTAefr74wX
 D33qCzAI1Av6lsuPbuBBOvoBf4gvhsyo7aiY2TQDWaCg+UMWukapJZTOpyiqOGCv
 99C5HCPi3l1CFYfG3bR91xq448aGTfJ9xedKhdAelLr5zEvsHnYblB5koxCstjLJ
 B4Xe/KiP
 =KT02
 -----END PGP SIGNATURE-----

Merge tag '0.27_rc1'

notmuch 0.27~rc1 release
2018-06-02 15:54:28 -03:00
David Bremner
db8602120a debian: changelog stanza for 0.27~rc1-1 2018-05-31 08:19:25 -03:00
David Bremner
98bdbae9f9 version: bump to 0.27~rc1 2018-05-31 08:17:12 -03:00
David Bremner
b71fa262b5 configure: check for links to/from libdir in ldconfig output
If e.g. /lib is a link to /usr/lib, then the latter may not show up in
the way we expect in the output of ldconfig. 'test foo -ef bar' checks
if foo and bar have the same device and inode numbers. Since (at least
in bash, dash, ksh, and zsh) the shell dereferences symlinks before
applying the test, this includes both the case where file1 is equal to
file2 and the case where one is a symlink to the other.
2018-05-31 08:14:47 -03:00
David Bremner
2f59498d69 NEWS: document installation of notmuch-emacs manual 2018-05-29 22:31:07 -03:00
David Bremner
a8c5256457 NEWS: mention notmuch --full-scan 2018-05-29 22:07:42 -03:00
David Bremner
fbf644d553 NEWS: mention thread:{} queries 2018-05-29 21:48:55 -03:00
David Bremner
460749d357 NEWS: deprecate pre-1.4.0 Xapian
We want to give people some heads up before dropping support, since
removing a bunch of ifdefs will be a pain to revert.
2018-05-29 20:57:37 -03:00
David Bremner
fd20a31e4c debian: update symbols for 0.27
add two new API symbols
2018-05-27 13:15:48 -07:00
David Bremner
cf68a0c257 NEWS: start entry for 0.27
No content yet.
2018-05-27 12:16:02 -07:00
David Bremner
46cf1a98f3 test: fix hardcoded paths in T050-new.sh
The previous paths will fail almost everywhere.
2018-05-26 16:46:44 -07:00
David Bremner
337b6cd790 debian: changelog for 0.27~rc0-1 2018-05-26 09:13:09 -07:00
David Bremner
c6225a00f5 bump version to 0.27~rc0
Start the busywork for a new release
2018-05-26 09:11:49 -07:00
David Bremner
b50fb1b642 docs: add initial documentation for notmuch-tag-jump
This is mainly to improve discoverability. It seems that doing
variable cross-references is not easy without using some sphinx
extension/customization.
2018-05-26 08:31:03 -07:00