Pytreceval: An Extremely Fast Python Interface to treceval
Abstract
We introduce pytreceval, a Python interface to the treeeval information retrieval evaluation toolkit. pytreceval exposes the reference implementations of treceval within Python as a native extension. We show that pytreceval is around one order of magnitude faster than invoking treceval as a sub process from within Python. Compared to a native Python implementation of NDCG, pytreceval is twice as fast for practically-sized rankings. Finally, we demonstrate its effectiveness in an application where pytreceval is combined with Pyndri and the OpenAI Gym where query expansion is learned using Q-learning.
Turn this paper into a lesson
ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.