Whoosh 0.3 release notes

Whoosh 0.3 release notes

Whoosh 0.3 release notes

  • Major improvements to reading/writing of postings and query performance.

  • Changed default post limit (run size) from 4 MB to 32 MB.

  • Finished migrating backend-specific code into whoosh.filedb package.

  • Moved formats from whoosh.fields module into new whoosh.formats module.

  • DocReader and TermReader classes combined into new IndexReader interface. You can get an IndexReader implementation by calling Index.reader(). Searcher is now a wrapper around an IndexReader.

  • Range query object changed, with new signature and new syntax in the default query parser. Now you can use [start TO end] in the query parser for an inclusive range, and {start TO end} for an exclusive range. You can also mix the delimiters, for example [start TO end} for a range with an inclusive start but exclusive end term.

  • Added experimental DATETIME field type lets you pass a datetime.datetime object as a field value to add_document:

    from whoosh.fields import Schema, ID, DATETIME
    from whoosh.filedb.filestore import RamStorage
    from datetime import datetime
    
    schema = Schema(id=ID, date=DATETIME)
    storage = RamStorage()
    ix = storage.create_index(schema)
    w = ix.writer()
    w.add_document(id=u"A", date=datetime.now())
    w.close()
    

    Internally, the DATETIME field indexes the datetime object as text using the format (4 digit year + 2 digit month + 2 digit day + ‘T’ + 2 digit hour + 2 digit minute + 2 digit second + 6 digit microsecond), for example 20090817T160203109000.

  • The default query parser now lets you use quoted strings in prefix and range queries, e.g. ["2009-05" TO "2009-12"], "alfa/bravo"*, making it easier to work with terms containing special characters.

  • DocReader.vector_as(docnum, fieldid, astype) is now IndexReader.vector_as(astype, docnum, fieldid) (i.e. the astype argument has moved from the last to the first argument), e.g. v = ixreader.vector_as("frequency", 102, "content").

  • Added whoosh.support.charset for translating Sphinx charset table files.

  • Added whoosh.analysis.CharsetTokenizer and CharsetFilter to enable case and accent folding.

  • Added experimental whoosh.ramdb in-memory backend.

  • Added experimental whoosh.query.FuzzyTerm query type.

  • Added whoosh.lang.wordnet module containing Thesaurus object for using WordNet synonym database.