Novel Class Discovery for Representation of Real-World Heritage Data as Neural Radiance Fields (Student Abstract)

Authors

  • Shivanand Kundargi Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
  • Tejas Anvekar Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
  • Ramesh Tabib Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
  • Uma Mudenagudi Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India

DOI:

https://doi.org/10.1609/aaai.v38i21.30469

Keywords:

Neural Radiance Fields, Novel Class Discovery, Crowdsourced Real-World Heritage Data, Computer Vision

Abstract

Neural Radiance Fields (NeRF) have been extensively explored as a leading approach for modeling and representing 3D data across various domains. Their ability to capture arbitrary scale point clouds and generate novel views makes them particularly valuable for digitizing cultural heritage sites. However, despite their impressive rendering capabilities, prior methods have often overlooked a significant real-world challenge: handling open-world scenarios characterized by unstructured data containing multiple classes in a single set of unlabeled images. To address this challenge, we propose a novel method NCD-NeRF that leverages Novel-Class Discovery to effectively tackle the complexities inherent in real-world data with unlabeled classes while excelling in producing high-quality NeRF representation. To validate our approach, we conducted a benchmarking analysis using a custom-collected dataset featuring UNESCO World Heritage sites in India. We observe that our proposed NCD-NeRF can parallely discover novel classes and render high-quality 3D volumes.

Downloads

Published

2024-03-24

How to Cite

Kundargi, S., Anvekar, T., Tabib, R., & Mudenagudi, U. (2024). Novel Class Discovery for Representation of Real-World Heritage Data as Neural Radiance Fields (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 38(21), 23552-23553. https://doi.org/10.1609/aaai.v38i21.30469