Skip to content

2025WWW 2025ShortRetrievers and rerankerscited 25×First author

ReSLLM: Large Language Models are Strong Resource Selectors for Federated Search

Shuai Wang, Shengyao Zhuang, Bevan Koopman, Guido Zuccon

Companion Proceedings of the ACM Web Conference 2025 (WWW 2025)

Paper ↗

Abstract

Federated search, which involves integrating results from multiple independent search engines, will become increasingly pivotal in the context of Retrieval-Augmented Generation pipelines empowering LLM-based applications such as chatbots. These systems often distribute queries among various search engines, ranging from specialized (e.g., PubMed) to general (e.g., Google), based on the nature of user utterances. A critical aspect of federated search is resource selection - the selection of appropriate resources prior to issuing the query to ensure high-quality and rapid responses, and contain costs associated with calling the external search engines. However, current SOTA resource selection methodologies primarily rely on feature-based learning approaches. These methods often involve the labour intensive and expensive creation of training labels for each resource. In contrast, LLMs have exhibited strong effectiveness as zero-shot methods across NLP and IR tasks. We hypothesise that in the context of federated search LLMs can assess the relevance of resources without the need for extensive predefined labels or features. In this paper, we propose ReSLLM. Our ReSLLM method exploits LLMs to drive the selection of resources in federated search in a zero-shot setting. In addition, we devise an unsupervised fine tuning protocol, the Synthetic Label Augmentation Tuning (SLAT), where the relevance of previously logged queries and snippets from resources is predicted using an off-the-shelf LLM and then in turn used to fine-tune ReSLLM with respect to resource selection. Our empirical evaluation and analysis details the factors

Cite · BibTeX
@inproceedings{wang2025resllm,
  title = {{ReSLLM: Large Language Models are Strong Resource Selectors for Federated Search}},
  author = {Shuai Wang and Shengyao Zhuang and Bevan Koopman and Guido Zuccon},
  booktitle = {Companion Proceedings of the ACM Web Conference 2025 (WWW 2025)},
  year = {2025},
  url = {https://doi.org/10.1145/3701716.3715595}
}

Part of project

Retrievers and rerankers · 2025

ReSLLM

Using language models to select resources for federated search, including the SLAT fine-tuning protocol.