notmuch: Start actually adding messages to the index.
This is the beginning of the notmuch library as well, with its
interface in notmuch.h. So far we've got create, open, close, and
add_message (all with a notmuch_database prefix).
The current add_message function has already been whittled down from
what we have in notmuch-index-message to add only references,
message-id, and thread-id to the index, (that is---just enough to do
thread-linkage but nothing for full-text searching).
The concept here is to do something quickly so that the user can get
some data into notmuch and start using it. (The most interesting stuff
is then thread-linkage and labels like inbox and unread.) We can
defer the full-text indexing of the body of the messages for later,
(such as in the background while the user is reading mail).
The initial thread-stitching step is still slower than I would like.
We may have to stop using libgmime for this step as its overhead is
not worth it for the simple case of just parsing the message-id,
references, and in-reply-to headers.
2009-10-19 05:56:30 +02:00
|
|
|
/* notmuch-private.h - Internal interfaces for notmuch.
|
|
|
|
*
|
|
|
|
* Copyright © 2009 Carl Worth
|
|
|
|
*
|
|
|
|
* This program is free software: you can redistribute it and/or modify
|
|
|
|
* it under the terms of the GNU General Public License as published by
|
|
|
|
* the Free Software Foundation, either version 3 of the License, or
|
|
|
|
* (at your option) any later version.
|
|
|
|
*
|
|
|
|
* This program is distributed in the hope that it will be useful,
|
|
|
|
* but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
|
|
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
|
|
* GNU General Public License for more details.
|
|
|
|
*
|
|
|
|
* You should have received a copy of the GNU General Public License
|
|
|
|
* along with this program. If not, see http://www.gnu.org/licenses/ .
|
|
|
|
*
|
|
|
|
* Author: Carl Worth <cworth@cworth.org>
|
|
|
|
*/
|
|
|
|
|
|
|
|
#ifndef NOTMUCH_PRIVATE_H
|
|
|
|
#define NOTMUCH_PRIVATE_H
|
|
|
|
|
2009-10-20 07:34:59 +02:00
|
|
|
#ifndef _GNU_SOURCE
|
2009-10-26 23:17:10 +01:00
|
|
|
#define _GNU_SOURCE /* For getline and asprintf */
|
2009-10-20 07:34:59 +02:00
|
|
|
#endif
|
2009-10-19 21:54:40 +02:00
|
|
|
#include <stdio.h>
|
2009-10-23 23:31:01 +02:00
|
|
|
|
|
|
|
#include "notmuch.h"
|
|
|
|
|
|
|
|
NOTMUCH_BEGIN_DECLS
|
|
|
|
|
notmuch: Start actually adding messages to the index.
This is the beginning of the notmuch library as well, with its
interface in notmuch.h. So far we've got create, open, close, and
add_message (all with a notmuch_database prefix).
The current add_message function has already been whittled down from
what we have in notmuch-index-message to add only references,
message-id, and thread-id to the index, (that is---just enough to do
thread-linkage but nothing for full-text searching).
The concept here is to do something quickly so that the user can get
some data into notmuch and start using it. (The most interesting stuff
is then thread-linkage and labels like inbox and unread.) We can
defer the full-text indexing of the body of the messages for later,
(such as in the background while the user is reading mail).
The initial thread-stitching step is still slower than I would like.
We may have to stop using libgmime for this step as its overhead is
not worth it for the simple case of just parsing the message-id,
references, and in-reply-to headers.
2009-10-19 05:56:30 +02:00
|
|
|
#include <stdlib.h>
|
2009-10-19 21:54:40 +02:00
|
|
|
#include <stdarg.h>
|
|
|
|
#include <sys/types.h>
|
|
|
|
#include <sys/stat.h>
|
|
|
|
#include <sys/mman.h>
|
notmuch: Start actually adding messages to the index.
This is the beginning of the notmuch library as well, with its
interface in notmuch.h. So far we've got create, open, close, and
add_message (all with a notmuch_database prefix).
The current add_message function has already been whittled down from
what we have in notmuch-index-message to add only references,
message-id, and thread-id to the index, (that is---just enough to do
thread-linkage but nothing for full-text searching).
The concept here is to do something quickly so that the user can get
some data into notmuch and start using it. (The most interesting stuff
is then thread-linkage and labels like inbox and unread.) We can
defer the full-text indexing of the body of the messages for later,
(such as in the background while the user is reading mail).
The initial thread-stitching step is still slower than I would like.
We may have to stop using libgmime for this step as its overhead is
not worth it for the simple case of just parsing the message-id,
references, and in-reply-to headers.
2009-10-19 05:56:30 +02:00
|
|
|
#include <string.h>
|
2009-10-19 21:54:40 +02:00
|
|
|
#include <errno.h>
|
|
|
|
#include <fcntl.h>
|
|
|
|
#include <unistd.h>
|
|
|
|
#include <ctype.h>
|
2009-10-25 08:25:59 +01:00
|
|
|
#include <assert.h>
|
notmuch: Start actually adding messages to the index.
This is the beginning of the notmuch library as well, with its
interface in notmuch.h. So far we've got create, open, close, and
add_message (all with a notmuch_database prefix).
The current add_message function has already been whittled down from
what we have in notmuch-index-message to add only references,
message-id, and thread-id to the index, (that is---just enough to do
thread-linkage but nothing for full-text searching).
The concept here is to do something quickly so that the user can get
some data into notmuch and start using it. (The most interesting stuff
is then thread-linkage and labels like inbox and unread.) We can
defer the full-text indexing of the body of the messages for later,
(such as in the background while the user is reading mail).
The initial thread-stitching step is still slower than I would like.
We may have to stop using libgmime for this step as its overhead is
not worth it for the simple case of just parsing the message-id,
references, and in-reply-to headers.
2009-10-19 05:56:30 +02:00
|
|
|
|
2009-10-21 06:03:30 +02:00
|
|
|
#include <talloc.h>
|
|
|
|
|
2009-10-21 22:57:02 +02:00
|
|
|
#include "xutil.h"
|
2009-10-21 06:03:30 +02:00
|
|
|
|
2009-10-25 22:54:13 +01:00
|
|
|
#ifdef DEBUG
|
|
|
|
# define DEBUG_DATABASE_SANITY 1
|
|
|
|
# define DEBUG_QUERY 1
|
|
|
|
#endif
|
|
|
|
|
2009-10-25 07:58:06 +01:00
|
|
|
#define COMPILE_TIME_ASSERT(pred) ((void)sizeof(char[1 - 2*!(pred)]))
|
|
|
|
|
2009-10-25 22:54:13 +01:00
|
|
|
/* There's no point in continuing when we've detected that we've done
|
|
|
|
* something wrong internally (as opposed to the user passing in a
|
|
|
|
* bogus value).
|
|
|
|
*
|
|
|
|
* Note that PRINTF_ATTRIBUTE comes from talloc.h
|
|
|
|
*/
|
|
|
|
int
|
|
|
|
_internal_error (const char *format, ...) PRINTF_ATTRIBUTE (1, 2);
|
|
|
|
|
2009-10-25 18:22:41 +01:00
|
|
|
/* There's no point in continuing when we've detected that we've done
|
|
|
|
* something wrong internally (as opposed to the user passing in a
|
|
|
|
* bogus value).
|
|
|
|
*
|
|
|
|
* Note that __location__ comes from talloc.h.
|
|
|
|
*/
|
|
|
|
#define INTERNAL_ERROR(format, ...) \
|
2009-10-25 22:54:13 +01:00
|
|
|
_internal_error (format " (%s).\n", \
|
|
|
|
##__VA_ARGS__, __location__)
|
2009-10-25 18:22:41 +01:00
|
|
|
|
2009-10-25 23:53:27 +01:00
|
|
|
#define unused(x) x __attribute__ ((unused))
|
|
|
|
|
2009-10-21 06:03:30 +02:00
|
|
|
/* Thanks to Andrew Tridgell's (SAMBA's) talloc for this definition of
|
|
|
|
* unlikely. The talloc source code comes to us via the GNU LGPL v. 3.
|
|
|
|
*/
|
|
|
|
/* these macros gain us a few percent of speed on gcc */
|
|
|
|
#if (__GNUC__ >= 3)
|
|
|
|
/* the strange !! is to ensure that __builtin_expect() takes either 0 or 1
|
|
|
|
as its first argument */
|
|
|
|
#ifndef likely
|
|
|
|
#define likely(x) __builtin_expect(!!(x), 1)
|
|
|
|
#endif
|
|
|
|
#ifndef unlikely
|
|
|
|
#define unlikely(x) __builtin_expect(!!(x), 0)
|
|
|
|
#endif
|
|
|
|
#else
|
|
|
|
#ifndef likely
|
|
|
|
#define likely(x) (x)
|
|
|
|
#endif
|
|
|
|
#ifndef unlikely
|
|
|
|
#define unlikely(x) (x)
|
|
|
|
#endif
|
|
|
|
#endif
|
|
|
|
|
2009-10-21 09:35:56 +02:00
|
|
|
typedef enum {
|
2009-10-25 07:05:08 +01:00
|
|
|
NOTMUCH_VALUE_TIMESTAMP = 0,
|
2009-10-25 08:25:59 +01:00
|
|
|
NOTMUCH_VALUE_MESSAGE_ID
|
2009-10-21 09:35:56 +02:00
|
|
|
} notmuch_value_t;
|
|
|
|
|
2009-10-21 23:10:00 +02:00
|
|
|
/* Xapian (with flint backend) complains if we provide a term longer
|
|
|
|
* than this, but I haven't yet found a way to query the limit
|
|
|
|
* programmatically. */
|
|
|
|
#define NOTMUCH_TERM_MAX 245
|
2009-10-21 23:07:40 +02:00
|
|
|
|
2009-10-22 00:53:38 +02:00
|
|
|
typedef enum _notmuch_private_status {
|
|
|
|
/* First, copy all the public status values. */
|
|
|
|
NOTMUCH_PRIVATE_STATUS_SUCCESS = NOTMUCH_STATUS_SUCCESS,
|
2009-10-25 17:47:21 +01:00
|
|
|
NOTMUCH_PRIVATE_STATUS_OUT_OF_MEMORY = NOTMUCH_STATUS_OUT_OF_MEMORY,
|
2009-10-22 00:53:38 +02:00
|
|
|
NOTMUCH_PRIVATE_STATUS_XAPIAN_EXCEPTION = NOTMUCH_STATUS_XAPIAN_EXCEPTION,
|
|
|
|
NOTMUCH_PRIVATE_STATUS_FILE_NOT_EMAIL = NOTMUCH_STATUS_FILE_NOT_EMAIL,
|
|
|
|
NOTMUCH_PRIVATE_STATUS_NULL_POINTER = NOTMUCH_STATUS_NULL_POINTER,
|
|
|
|
NOTMUCH_PRIVATE_STATUS_TAG_TOO_LONG = NOTMUCH_STATUS_TAG_TOO_LONG,
|
|
|
|
|
|
|
|
/* Then add our own private values. */
|
|
|
|
NOTMUCH_PRIVATE_STATUS_TERM_TOO_LONG,
|
2009-10-23 23:24:07 +02:00
|
|
|
NOTMUCH_PRIVATE_STATUS_NO_DOCUMENT_FOUND,
|
2009-10-22 00:53:38 +02:00
|
|
|
|
|
|
|
NOTMUCH_PRIVATE_STATUS_LAST_STATUS
|
|
|
|
} notmuch_private_status_t;
|
|
|
|
|
2009-10-25 22:54:13 +01:00
|
|
|
/* Coerce a notmuch_private_status_t value to a notmuch_status_t
|
|
|
|
* value, generating an internal error if the private value is equal
|
|
|
|
* to or greater than NOTMUCH_STATUS_LAST_STATUS. (The idea here is
|
|
|
|
* that the caller has previously handled any expected
|
|
|
|
* notmuch_private_status_t values.)
|
|
|
|
*/
|
|
|
|
#define COERCE_STATUS(private_status, format, ...) \
|
|
|
|
((private_status >= (notmuch_private_status_t) NOTMUCH_STATUS_LAST_STATUS)\
|
|
|
|
? \
|
|
|
|
(notmuch_status_t) _internal_error (format " (%s).\n", \
|
|
|
|
##__VA_ARGS__, \
|
|
|
|
__location__) \
|
|
|
|
: \
|
|
|
|
(notmuch_status_t) private_status)
|
|
|
|
|
2009-10-27 01:35:31 +01:00
|
|
|
/* database.cc */
|
|
|
|
|
|
|
|
/* Lookup a prefix value by name.
|
|
|
|
*
|
|
|
|
* XXX: This should really be static inside of message.cc, and we can
|
|
|
|
* do that once we convert database.cc to use the
|
|
|
|
* _notmuch_message_add/remove_term functions. */
|
|
|
|
const char *
|
|
|
|
_find_prefix (const char *name);
|
|
|
|
|
2009-10-26 07:12:20 +01:00
|
|
|
/* thread.cc */
|
|
|
|
|
|
|
|
notmuch_thread_t *
|
2009-11-13 07:01:44 +01:00
|
|
|
_notmuch_thread_create (void *ctx,
|
2009-10-26 07:12:20 +01:00
|
|
|
notmuch_database_t *notmuch,
|
2009-11-13 07:01:44 +01:00
|
|
|
const char *thread_id,
|
|
|
|
const char *query_string);
|
2009-10-26 07:12:20 +01:00
|
|
|
|
2009-10-21 06:03:30 +02:00
|
|
|
/* message.cc */
|
|
|
|
|
|
|
|
notmuch_message_t *
|
2009-10-22 00:37:51 +02:00
|
|
|
_notmuch_message_create (const void *talloc_owner,
|
2009-10-21 06:03:30 +02:00
|
|
|
notmuch_database_t *notmuch,
|
2009-10-25 17:47:21 +01:00
|
|
|
unsigned int doc_id,
|
|
|
|
notmuch_private_status_t *status);
|
2009-10-21 06:03:30 +02:00
|
|
|
|
2009-10-23 14:53:52 +02:00
|
|
|
notmuch_message_t *
|
|
|
|
_notmuch_message_create_for_message_id (const void *talloc_owner,
|
|
|
|
notmuch_database_t *notmuch,
|
2009-10-25 17:47:21 +01:00
|
|
|
const char *message_id,
|
2009-10-29 00:50:14 +01:00
|
|
|
notmuch_private_status_t *status);
|
2009-10-23 14:53:52 +02:00
|
|
|
|
2009-10-21 23:07:40 +02:00
|
|
|
const char *
|
2009-10-27 01:35:31 +01:00
|
|
|
_notmuch_message_get_subject (notmuch_message_t *message);
|
2009-10-21 23:07:40 +02:00
|
|
|
|
2009-10-22 00:53:38 +02:00
|
|
|
notmuch_private_status_t
|
|
|
|
_notmuch_message_add_term (notmuch_message_t *message,
|
|
|
|
const char *prefix_name,
|
|
|
|
const char *value);
|
|
|
|
|
|
|
|
notmuch_private_status_t
|
|
|
|
_notmuch_message_remove_term (notmuch_message_t *message,
|
|
|
|
const char *prefix_name,
|
|
|
|
const char *value);
|
|
|
|
|
2009-10-28 18:42:07 +01:00
|
|
|
notmuch_private_status_t
|
|
|
|
_notmuch_message_gen_terms (notmuch_message_t *message,
|
|
|
|
const char *prefix_name,
|
|
|
|
const char *text);
|
|
|
|
|
2009-10-23 14:41:17 +02:00
|
|
|
void
|
|
|
|
_notmuch_message_set_filename (notmuch_message_t *message,
|
|
|
|
const char *filename);
|
|
|
|
|
|
|
|
void
|
|
|
|
_notmuch_message_add_thread_id (notmuch_message_t *message,
|
|
|
|
const char *thread_id);
|
|
|
|
|
|
|
|
void
|
|
|
|
_notmuch_message_ensure_thread_id (notmuch_message_t *message);
|
|
|
|
|
|
|
|
void
|
|
|
|
_notmuch_message_set_date (notmuch_message_t *message,
|
|
|
|
const char *date);
|
|
|
|
|
|
|
|
void
|
|
|
|
_notmuch_message_sync (notmuch_message_t *message);
|
|
|
|
|
2009-10-28 18:42:07 +01:00
|
|
|
/* index.cc */
|
|
|
|
|
|
|
|
notmuch_status_t
|
|
|
|
_notmuch_message_index_file (notmuch_message_t *message,
|
|
|
|
const char *filename);
|
|
|
|
|
2009-10-21 00:09:51 +02:00
|
|
|
/* message-file.c */
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* XXX: I haven't decided yet whether these will actually get exported
|
|
|
|
* into the public interface in notmuch.h
|
|
|
|
*/
|
|
|
|
|
2009-10-21 00:09:51 +02:00
|
|
|
typedef struct _notmuch_message_file notmuch_message_file_t;
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* Open a file containing a single email message.
|
|
|
|
*
|
|
|
|
* The caller should call notmuch_message_close when done with this.
|
|
|
|
*
|
|
|
|
* Returns NULL if any error occurs.
|
|
|
|
*/
|
2009-10-21 00:09:51 +02:00
|
|
|
notmuch_message_file_t *
|
|
|
|
notmuch_message_file_open (const char *filename);
|
2009-10-19 21:54:40 +02:00
|
|
|
|
2009-10-27 01:35:31 +01:00
|
|
|
/* Like notmuch_message_file_open but with 'ctx' as the talloc owner. */
|
|
|
|
notmuch_message_file_t *
|
|
|
|
_notmuch_message_file_open_ctx (void *ctx, const char *filename);
|
|
|
|
|
2009-10-19 21:54:40 +02:00
|
|
|
/* Close a notmuch message preivously opened with notmuch_message_open. */
|
|
|
|
void
|
2009-10-21 00:09:51 +02:00
|
|
|
notmuch_message_file_close (notmuch_message_file_t *message);
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* Restrict 'message' to only save the named headers.
|
|
|
|
*
|
|
|
|
* When the caller is only interested in a short list of headers,
|
|
|
|
* known in advance, calling this function can avoid wasted time and
|
|
|
|
* memory parsing/saving header values that will never be needed.
|
|
|
|
*
|
|
|
|
* The variable arguments should be a list of const char * with a
|
|
|
|
* final '(const char *) NULL' to terminate the list.
|
|
|
|
*
|
|
|
|
* If this function is called, it must be called before any calls to
|
|
|
|
* notmuch_message_get_header for this message.
|
|
|
|
*
|
|
|
|
* After calling this function, if notmuch_message_get_header is
|
|
|
|
* called with a header name not in this list, then NULL will be
|
|
|
|
* returned even if that header exists in the actual message.
|
|
|
|
*/
|
|
|
|
void
|
2009-10-21 00:09:51 +02:00
|
|
|
notmuch_message_file_restrict_headers (notmuch_message_file_t *message, ...);
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* Identical to notmuch_message_restrict_headers but accepting a va_list. */
|
|
|
|
void
|
2009-10-21 00:09:51 +02:00
|
|
|
notmuch_message_file_restrict_headersv (notmuch_message_file_t *message,
|
|
|
|
va_list va_headers);
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* Get the value of the specified header from the message.
|
|
|
|
*
|
|
|
|
* The header name is case insensitive.
|
|
|
|
*
|
|
|
|
* The returned value is owned by the notmuch message and is valid
|
|
|
|
* only until the message is closed. The caller should copy it if
|
|
|
|
* needing to modify the value or to hold onto it for longer.
|
|
|
|
*
|
|
|
|
* Returns NULL if the message does not contain a header line matching
|
|
|
|
* 'header'.
|
|
|
|
*/
|
|
|
|
const char *
|
2009-10-21 00:09:51 +02:00
|
|
|
notmuch_message_file_get_header (notmuch_message_file_t *message,
|
|
|
|
const char *header);
|
2009-10-19 21:54:40 +02:00
|
|
|
|
|
|
|
/* date.c */
|
|
|
|
|
|
|
|
/* Parse an RFC 8222 date string to a time_t value.
|
|
|
|
*
|
|
|
|
* The tz_offset argument can be used to also obtain the time-zone
|
|
|
|
* offset, (but can be NULL if the call is not interested in that).
|
|
|
|
*
|
|
|
|
* Returns 0 on error.
|
|
|
|
*/
|
|
|
|
time_t
|
|
|
|
notmuch_parse_date (const char *str, int *tz_offset);
|
|
|
|
|
2009-10-23 00:31:56 +02:00
|
|
|
/* sha1.c */
|
|
|
|
|
2009-10-23 22:54:53 +02:00
|
|
|
char *
|
|
|
|
notmuch_sha1_of_string (const char *str);
|
|
|
|
|
2009-10-23 00:31:56 +02:00
|
|
|
char *
|
|
|
|
notmuch_sha1_of_file (const char *filename);
|
|
|
|
|
2009-10-26 17:13:19 +01:00
|
|
|
/* tags.c */
|
|
|
|
|
|
|
|
notmuch_tags_t *
|
|
|
|
_notmuch_tags_create (void *ctx);
|
|
|
|
|
|
|
|
void
|
|
|
|
_notmuch_tags_add_tag (notmuch_tags_t *tags, const char *tag);
|
|
|
|
|
|
|
|
void
|
2009-10-26 22:12:56 +01:00
|
|
|
_notmuch_tags_prepare_iterator (notmuch_tags_t *tags);
|
2009-10-26 17:13:19 +01:00
|
|
|
|
notmuch: Start actually adding messages to the index.
This is the beginning of the notmuch library as well, with its
interface in notmuch.h. So far we've got create, open, close, and
add_message (all with a notmuch_database prefix).
The current add_message function has already been whittled down from
what we have in notmuch-index-message to add only references,
message-id, and thread-id to the index, (that is---just enough to do
thread-linkage but nothing for full-text searching).
The concept here is to do something quickly so that the user can get
some data into notmuch and start using it. (The most interesting stuff
is then thread-linkage and labels like inbox and unread.) We can
defer the full-text indexing of the body of the messages for later,
(such as in the background while the user is reading mail).
The initial thread-stitching step is still slower than I would like.
We may have to stop using libgmime for this step as its overhead is
not worth it for the simple case of just parsing the message-id,
references, and in-reply-to headers.
2009-10-19 05:56:30 +02:00
|
|
|
NOTMUCH_END_DECLS
|
|
|
|
|
|
|
|
#endif
|