Repository navigation
[Feature Request] Batch Encoding of Queries #2270
Description
In https://github.com/castorini/pyserini/blob/master/pyserini/encode/_auto.py
though AutoDocumentEncoder allows batch encoding, but AutoQueryEncoder encodes one query at a time.
This forces FaissSearcher # batch_search function to encode one query at a time
pyserini/pyserini/search/faiss/_searcher.py
Line 194 in 9815d56
def _enc(q):
if isinstance(q, dict):
return self.query_encoder.encode(**q)
assert isinstance(q, str)
return self.query_encoder.encode(q)
q_embs = [_enc(q) for q in queries]
Allowing batch encoding for queries would improve performance of batch_search
Reacted by Yash Singh
Activity