EIDSeg: A Pixel-Level Semantic Segmentation Dataset for Post-Earthquake Damage Assessment from Social Media Images

Authors

  • Huili Huang School of Computational Science and Engineering,Georgia Institute of Technology, Atlanta, USA
  • Chengeng Liu School of Civil and Environmental Engineering,Georgia Institute of Technology, Atlanta, USA
  • Danrong Zhang School of Computational Science and Engineering,Georgia Institute of Technology, Atlanta, USA
  • Shail Patel School of Computer Science,Georgia Institute of Technology, Atlanta,USA
  • Anastasiya Masalava School of Computer Science,Georgia Institute of Technology, Atlanta,USA
  • Sagar Sadak School of Computer Science,Georgia Institute of Technology, Atlanta,USA
  • Parisa Babolhavaeji School of Computer Science,Georgia Institute of Technology, Atlanta,USA
  • WeiHong Low School of Computer Science,Georgia Institute of Technology, Atlanta,USA
  • Max Mahdi Roozbahani School of Computing Instruction, Georgia Institute of Technology, Atlanta,USA
  • J. David Frost School of Civil and Environmental Engineering,Georgia Institute of Technology, Atlanta, USA

DOI:

https://doi.org/10.1609/aaai.v40i45.41201

Abstract

Rapid post‑earthquake damage assessment is crucial for rescue and resource planning. Still, existing remote sensing methods depend on costly aerial images, expert labeling, and produce only binary damage maps for early-stage evaluation. Although ground-level images from social networks provide a valuable source to fill this gap, a large pixel-level annotated dataset for this task is still unavailable. We introduce EIDSeg, the first large-scale semantic segmentation dataset specifically for post-earthquake social media imagery. The dataset comprises 3,266 images from nine major earthquakes (2008–2023), annotated across five classes of infrastructure damage. Undamaged Building, Damaged Building, Destroyed Building, Undamaged Road, and Damaged Road. We propose a practical three-phase cross-disciplinary annotation protocol with labeling guidelines that enables consistent segmentation by non-expert annotators, achieving over 70% inter-annotator agreement. We benchmark several state-of-the-art segmentation models, identifying Encoder-only Mask Transformer (EoMT) as the top-performing method with a Mean Intersection over Union (mIoU) of 80.8%. By unlocking social networks' rich, ground-level perspective, our work paves the way for a faster, finer-grained damage assessment in the post-earthquake scenario.

Published

2026-03-14

How to Cite

Huang, H., Liu, C., Zhang, D., Patel, S., Masalava, A., Sadak, S., … Frost, J. D. (2026). EIDSeg: A Pixel-Level Semantic Segmentation Dataset for Post-Earthquake Damage Assessment from Social Media Images. Proceedings of the AAAI Conference on Artificial Intelligence, 40(45), 38589–38597. https://doi.org/10.1609/aaai.v40i45.41201

Issue

Section

AAAI Special Track on AI for Social Impact I