RES: An Interpretable Replicability Estimation System for Research Publications
DOI:
https://doi.org/10.1609/aaai.v36i11.21737Keywords:
Replicability, Machine Learning, Explainable Artificial Intelligence, Natural Language Processing, Sentiment AnalysisAbstract
Reliable and faithful research is the cornerstone of breakthrough advancements and disruptive innovations. Assessing the credibility of scientific findings and claims in research publications has long been a time-consuming and challenging task for researchers and decision-makers. In this paper, we introduce RES - an intelligent system that assists humans in analyzing the credibility of scientific findings and claims in research publications in the field of social and behavioral sciences by estimating their replicability. The pipeline of RES consists of four major modules that perform feature extraction, replicability estimation, result explanation, and sentiment analysis respectively. Our evaluation based on human experts' assessments suggests that the RES has achieved adequate performance. The RES is also built with a Graphical User Interface (GUI) that is publicly accessible at https://tamu-infolab.github.io/RES/.Downloads
Published
2022-06-28
How to Cite
Wang, Z., Feng, Q., Chatterjee, M., Zhao, X., Liu, Y., Li, Y., Singh, A. K., Shipman, F. M., Hu, X., & Caverlee, J. (2022). RES: An Interpretable Replicability Estimation System for Research Publications. Proceedings of the AAAI Conference on Artificial Intelligence, 36(11), 13230-13232. https://doi.org/10.1609/aaai.v36i11.21737
Issue
Section
AAAI Demonstration Track