Computer Science > Computation and Language
arXiv:2308.08973 (cs)
[Submitted on 17 Aug 2023 (v1), last revised 1 Apr 2024 (this version, v2)]
Title:End-to-End Beam Retrieval for Multi-Hop Question Answering
View a PDF of the paper titled End-to-End Beam Retrieval for Multi-Hop Question Answering, by Jiahao Zhang and 3 other authors
View PDF
HTML (experimental)
Abstract:Multi-hop question answering (QA) involves finding multiple relevant passages and step-by-step reasoning to answer complex questions, indicating a retrieve-and-read paradigm. However, previous retrievers were customized for two-hop questions, and most of them were trained separately across different hops, resulting in a lack of supervision over the entire multi-hop retrieval process and leading to poor performance in complicated scenarios beyond two hops. In this work, we introduce Beam Retrieval, an end-to-end beam retrieval framework for multi-hop QA. This approach models the multi-hop retrieval process in an end-to-end manner by jointly optimizing an encoder and two classification heads across all hops. Moreover, Beam Retrieval maintains multiple partial hypotheses of relevant passages at each step, expanding the search space and reducing the risk of missing relevant passages. To establish a complete QA system, we incorporate a supervised reader or a large language model (LLM). Experimental results demonstrate that Beam Retrieval achieves a nearly 50% improvement compared with baselines on challenging MuSiQue-Ans, and it also surpasses all previous retrievers on HotpotQA and achieves 99.9% precision on 2WikiMultiHopQA. Providing high-quality context, Beam Retrieval helps our supervised reader achieve new state-of-the-art performance and substantially improves the few-shot QA performance of LLMs.
| Comments: | Accepted by NAACL 2024 Main Conference. Code is available at this https URL |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2308.08973 [cs.CL] |
| (or arXiv:2308.08973v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2308.08973
arXiv-issued DOI via DataCite
|
Submission history
From: Jiahao Zhang [view email][v1] Thu, 17 Aug 2023 13:24:14 UTC (7,314 KB)
[v2] Mon, 1 Apr 2024 08:30:38 UTC (8,638 KB)
Full-text links:
Access Paper:
- View PDF
- HTML (experimental)
- TeX Source
View a PDF of the paper titled End-to-End Beam Retrieval for Multi-Hop Question Answering, by Jiahao Zhang and 3 other authors
References & Citations
Loading...
BibTeX formatted citation
Data provided by:
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.