ChromaFusionNet (CFNet): Natural Fusion of Fine-Grained Color Editing

Authors

  • Yi Dong Nanyang Technological University
  • Yuxi Wang Nanyang Technological University
  • Ruoxi Fan Nanyang Technological University
  • Wenqi Ouyang Alibaba Group
  • Zhiqi Shen Nanyang Technological University
  • Peiran Ren Alibaba Group
  • Xuansong Xie Alibaba Group

DOI:

https://doi.org/10.1609/aaai.v38i2.27925

Keywords:

CV: Computational Photography, Image & Video Synthesis, CV: Low Level & Physics-based Vision

Abstract

Digital image enhancement aims to deliver visually striking, pleasing images that align with human perception. While global techniques can elevate the image's overall aesthetics, fine-grained color enhancement can further boost visual appeal and expressiveness. However, colorists frequently face challenges in achieving accurate, localized color adjustments. Direct composition of these local edits can result in spatial color inconsistencies. Existing methods, including color style transfer and image harmonization, exhibit inconsistencies, especially at boundary regions. Addressing this, we present ChromaFusionNet (CFNet), a novel approach that views the color fusion problem through the lens of image color inpainting. Built on the Vision Transformer architecture, CFNet captures global context and delivers high-fidelity outputs, seamlessly blending colors while preserving boundary integrity. Empirical studies on ImageNet and COCO datasets demonstrate CFNet's superiority over existing methods in maintaining color harmony and color fidelity. Robustness evaluations and user studies have further validated the effectiveness of CFNet. In conclusion, CFNet introduces an innovative approach to seamless, fine-grained color fusion, paving the way for advancements in the domain of fine-grained color editing. Code and pretrained models are available at our project page: https://yidong.pro/projects/cfnet.

Downloads

Published

2024-03-24

How to Cite

Dong, Y., Wang, Y., Fan, R., Ouyang, W., Shen, Z., Ren, P., & Xie, X. (2024). ChromaFusionNet (CFNet): Natural Fusion of Fine-Grained Color Editing. Proceedings of the AAAI Conference on Artificial Intelligence, 38(2), 1591-1599. https://doi.org/10.1609/aaai.v38i2.27925

Issue

Section

AAAI Technical Track on Computer Vision I