Phys-Liquid: A Physics-Informed Dataset for Estimating 3D Geometry and Volume of Transparent Deformable Liquids

Authors

  • Ke Ma School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
  • Yizhou Fang School of Software and Engineering, Huazhong University of Science and Technology
  • Jean-Baptiste Weibel Human-Centered AI Lab, Institute of Forest Engineering, BOKU University
  • Shuai Tan Shanghai Jiao Tong University
  • Xinggang Wang School of Electronic Information and Communications, Huazhong University of Science and Technology
  • Yang Xiao National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
  • Yi Fang Center for Artificial Intelligence and Robotics, New York University Abu Dhabi Embodied AI and Robotics (AIR) Lab, New York University
  • Tian Xia School of Software and Engineering, Huazhong University of Science and Technology

DOI:

https://doi.org/10.1609/aaai.v40i10.37721

Abstract

Estimating the geometric and volumetric properties of transparent deformable liquids is challenging due to optical complexities and dynamic surface deformations induced by container movements. Autonomous robots performing precise liquid manipulation tasks—such as dispensing, aspiration, and mixing—must handle containers in ways that inevitably induce these deformations, complicating accurate liquid state assessment. Current datasets lack comprehensive physics-informed simulation data representing realistic liquid behaviors under diverse dynamic scenarios. To bridge this gap, we introduce Phys-Liquid, a physics-informed dataset comprising 97,200 simulation images and corresponding 3D meshes, capturing liquid dynamics across multiple laboratory scenes, lighting conditions, liquid colors, and container rotations. To validate the realism and effectiveness of Phys-Liquid, we propose a four-stage reconstruction and estimation pipeline involving liquid segmentation, multi-view mask generation, 3D mesh reconstruction, and real-world scaling. Experimental results demonstrate improved accuracy and consistency in reconstructing liquid geometry and volume, outperforming existing benchmarks. The dataset and associated validation methods facilitate future advancements in transparent liquid perception tasks.

Published

2026-03-14

How to Cite

Ma, K., Fang, Y., Weibel, J.-B., Tan, S., Wang, X., Xiao, Y., … Xia, T. (2026). Phys-Liquid: A Physics-Informed Dataset for Estimating 3D Geometry and Volume of Transparent Deformable Liquids. Proceedings of the AAAI Conference on Artificial Intelligence, 40(10), 7782–7790. https://doi.org/10.1609/aaai.v40i10.37721

Issue

Section

AAAI Technical Track on Computer Vision VII