Low-Light Video Enhancement with Synthetic Event Guidance


  • Lin Liu University of Science and Technology of China
  • Junfeng An Independent researcher
  • Jianzhuang Liu Huawei Noah's Ark Lab
  • Shanxin Yuan Queen Mary University of London
  • Xiangyu Chen University of Macau; Shenzhen Institute of Advanced Technology (SIAT)
  • Wengang Zhou University of Science and Technology of China
  • Houqiang Li University of Science and Technology of China
  • Yan Feng Wang Cooperative medianet innovation center of Shanghai Jiao Tong University
  • Qi Tian Huawei Cloud BU




CV: Low Level & Physics-Based Vision, CV: Computational Photography, Image & Video Synthesis, CV: Multi-modal Vision


Low-light video enhancement (LLVE) is an important yet challenging task with many applications such as photographing and autonomous driving. Unlike single image low-light enhancement, most LLVE methods utilize temporal information from adjacent frames to restore the color and remove the noise of the target frame. However, these algorithms, based on the framework of multi-frame alignment and enhancement, may produce multi-frame fusion artifacts when encountering extreme low light or fast motion. In this paper, inspired by the low latency and high dynamic range of events, we use synthetic events from multiple frames to guide the enhancement and restoration of low-light videos. Our method contains three stages: 1) event synthesis and enhancement, 2) event and image fusion, and 3) low-light enhancement. In this framework, we design two novel modules (event-image fusion transform and event-guided dual branch) for the second and third stages, respectively. Extensive experiments show that our method outperforms existing low-light video or single image enhancement approaches on both synthetic and real LLVE datasets. Our code will be available at https://gitee.com/mindspore/models/tree/master/research/cv/LLVE-SEG.




How to Cite

Liu, L., An, J., Liu, J., Yuan, S., Chen, X., Zhou, W., Li, H., Wang, Y. F., & Tian, Q. (2023). Low-Light Video Enhancement with Synthetic Event Guidance. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 1692-1700. https://doi.org/10.1609/aaai.v37i2.25257



AAAI Technical Track on Computer Vision II