Optimal Margin Distribution Learning in Dynamic Environments

Authors

  • Teng Zhang Huazhong University of Science and Technology
  • Peng Zhao Nanjing University
  • Hai Jin Huazhong University of Science and Technology

DOI:

https://doi.org/10.1609/aaai.v34i04.6162

Abstract

Recently a promising research direction of statistical learning has been advocated, i.e., the optimal margin distribution learning with the central idea that instead of the minimal margin, the margin distribution is more crucial to the generalization performance. Although the superiority of this new learning paradigm has been verified under batch learning settings, it remains open for online learning settings, in particular, the dynamic environments in which the underlying decision function varies over time. In this paper, we propose the dynamic optimal margin distribution machine and theoretically analyze its regret. Although the obtained bound has the same order with the best known one, our method can significantly relax the restrictive assumption that the function variation should be given ahead of time, resulting in better applicability in practical scenarios. We also derive an excess risk bound for the special case when the underlying decision function only evolves several discrete changes rather than varying continuously. Extensive experiments on both synthetic and real data sets demonstrate the superiority of our method.

Downloads

Published

2020-04-03

How to Cite

Zhang, T., Zhao, P., & Jin, H. (2020). Optimal Margin Distribution Learning in Dynamic Environments. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 6821-6828. https://doi.org/10.1609/aaai.v34i04.6162

Issue

Section

AAAI Technical Track: Machine Learning