Physics-constrained Automatic Feature Engineering for Predictive Modeling in Materials Science
Keywords:Feature Construction/Reformulation, Reinforcement Learning, Scalability of ML Systems, Natural Sciences
AbstractAutomatic Feature Engineering (AFE) aims to extract useful knowledge for interpretable predictions given data for the machine learning tasks. Here, we develop AFE to extract dependency relationships that can be interpreted with functional formulas to discover physics meaning or new hypotheses for the problems of interest. We focus on materials science applications, where interpretable predictive modeling may provide principled understanding of materials systems and guide new materials discovery. It is often computationally prohibitive to exhaust all the potential relationships to construct and search the whole feature space to identify interpretable and predictive features. We develop and evaluate new AFE strategies by exploring a feature generation tree (FGT) with deep Q-network (DQN) for scalable and efficient exploration policies. The developed DQN-based AFE strategies are benchmarked with the existing AFE methods on several materials science datasets.
How to Cite
Xiang, Z., Fan, M., Vázquez Tovar, G., Trehern, W., Yoon, B.-J., Qian, X., Arroyave, R., & Qian, X. (2021). Physics-constrained Automatic Feature Engineering for Predictive Modeling in Materials Science. Proceedings of the AAAI Conference on Artificial Intelligence, 35(12), 10414-10421. https://doi.org/10.1609/aaai.v35i12.17247
AAAI Technical Track on Machine Learning V