Talaei, S.; Ansaripour, M.; Nadiradze, G.; Alistarh, D. Hybrid Decentralized Optimization: Leveraging Both First- and Zeroth-Order Optimizers for Faster Convergence. AAAI 2025, 39, 20778-20786.