CONVERSATIONAL AI
Ingest-And-Ground: Dispelling Hallucinations from Continually-Pretrained LLMs with RAG
September 30, 2024
Abstract
This paper presents new methods that have the potential to improve privacy process efficiency with LLM and RAG. To reduce hallucination, we continually pre-train the base LLM model with a privacy-specific knowledge base and then augment it with a semantic RAG layer. Our evaluations demonstrate that this approach enhances the model performance (as much as doubled metrics compared to out-of-box LLM) in handling privacy-related queries, by grounding responses with factual information which reduces inaccuracies.
AUTHORS
Written by
Chenhao Fang
Alex Goncalves
Arya Pudota
Derek Larson
Gabriel Forgues
Hervé Robert
Rajeev Rao
Shitong Zhu
Sophie Zeng
Wendy Summer
Yanqing Peng
Yuriy Hulovatyy
Publisher
3rd ACM International Conference on Information and Knowledge Management (CIKM 2024)
Research Topics
Related Publications
June 05, 2026
CONVERSATIONAL AI
RANKING AND RECOMMENDATIONS
Superintelligent Retrieval Agent: The Next Frontier of Agentic Retrieval
Anshumali Shrivastava, Jason Chen, Qi Ma, Zeyu Yang
June 05, 2026
May 18, 2026
CONVERSATIONAL AI
RESEARCH
GIM: Evaluating models via tasks that integrate multiple cognitive domains
Alexandre Rezende, Rohit Patel, Steven McClain
May 18, 2026
February 26, 2026
CONVERSATIONAL AI
RESEARCH
Learning Personalized Agents from Human Feedback
Kaiqu Liang, Xianjun Yang, Shaoliang Nie, Jaime Fernández Fisac, Shuyan Zhou, Julia Kruk, Lijuan Liu, Michael Zhang, Saghar Hosseini, Shengjie Bi, Shengyi Qian
February 26, 2026
December 01, 2025
CONVERSATIONAL AI
REINFORCEMENT LEARNING
Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following
Amine Benhalloum, Hany Awadalla, Hejia Zhang, Hunter Lang, Julian Katz-Samuels, Karishma Mandyam, Licheng Yu, Manaal Faruqui, Maryam Fazel-Zarandi, Nanshu Wang, Qi Qi, Richard Yuanzhe Pang, Selina Xiaoliang Peng, Shengjie Bi, Shengyu Feng, Shishir G. Patil, Sopan Khosla, Sujan Gonugondla, Vincent Li, Wenzhe Li, Yuanhao Xiong, Yue Yu, Yun He, Yundi Qian
December 01, 2025
Help Us Pioneer The Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Our approach
Latest news
Foundational models
Meta © 2026