When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing

Authors

  • Siyuan Xu City University of Hong Kong
  • Yibing Liu City University of Hong Kong
  • Peilin Chen City University of Hong Kong
  • Yung-Hui Li Hon Hai Research Institute
  • Shiqi Wang City University of Hong Kong
  • Sam Kwong Lingnan University

DOI:

https://doi.org/10.1609/aaai.v40i42.40911

Abstract

Privacy leakage in Multimodal Large Language Models (MLLMs) has long been an intractable problem. Existing studies, though effectively obscure private information in MLLMs, often overlook the evaluation of authenticity and recovery quality of user privacy. To this end, this work uniquely focuses on the critical challenge of how to restore surrogate-driven protected data in diverse MLLM scenarios. We first bridge this research gap by contributing the SPPE (Surrogate Privacy Protected Editable) dataset, which includes a wide range of privacy categories and user instructions to simulate real MLLM applications. This dataset offers protected surrogates alongside their various MLLM-edited versions, thus enabling the direct assessment of privacy recovery quality. By formulating privacy recovery as a guided generation task conditioned on complementary multimodal signals, we further introduce a unified approach that reliably reconstructs private content while preserving the fidelity of MLLM-generated edits. The experiments on both SPPE and InstructPix2Pix further show that our approach generalizes well across diverse visual content and editing tasks, achieving a strong balance between privacy protection and MLLM usability.

Published

2026-03-14

How to Cite

Xu, S., Liu, Y., Chen, P., Li, Y.-H., Wang, S., & Kwong, S. (2026). When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing. Proceedings of the AAAI Conference on Artificial Intelligence, 40(42), 35958–35966. https://doi.org/10.1609/aaai.v40i42.40911

Issue

Section

AAAI Technical Track on Philosophy and Ethics of AI