We propose novel Vidura advisor design framework (VADF) to develop dialog system designs for information retrieval (IR) and question-answering (QA) tasks, while enabling the quantification of system utility based on human performance in diverse application environments.
Jan 7, 2025
We introduce Chain-of-Query (CoQ), a novel prompting approach that enhances smaller language models (LMs) in multi-hop open-domain question answering (ODQA) by decomposing complex queries into context-aware subqueries, improving efficiency and factual accuracy. CoQ demonstrates up to 5.4% and 11.5% performance gains for small-scale and large-scale LMs, respectively, on benchmark datasets, making it a valuable solution for complex QA tasks.
Dec 15, 2024