Data-Quality-Navigated\nMachine Learning Strategy with\nChemical Intuition to Improve Generalization

Generalizing real-world data has been one of the most\ndifficult\nchallenges for application of machine learning (ML) in practice. Most\nML works focused on improvements in algorithms and feature representations.\nHowever, the data quality, as the foundation of ML, has been largely\noverlooked, also leading to the absence of data evaluation and processing\nmethods in ML fields. Motivated by the challenge and need, we selected\nan important but difficult reorganization energy (RE) prediction task\nas a test platform, which is an important parameter for the charge\nmobility of organic semiconductors (OSCs), to propose a data-quality-navigated\nstrategy with chemical intuition. We developed a data diversity evaluation\nbased on structure characteristics of OSC molecules, a reliability\nevaluation method based on prediction accuracy, a data filtering method\nbased on the uncertainty of <i>K</i>-fold division, and\na data split technique by clustering and stratified sampling based\non four molecular descriptor-associated REs. Consequently, a representative\nRE data set (15,989 molecules) with high reliability and diversity\ncan be obtained. For the feature representation, a complementary strategy\nis proposed by considering the chemical nature of REs and the structure\ncharacteristics of OCS molecules as well as the model algorithm. In\naddition, an ensemble framework consisting of two deep learning models\nis constructed to avoid the risk of local optimization of the single\nmodel. The robustness and generalization of our model are strongly\nvalidated against different OSC-like molecules with diverse structures\nand a wide range of REs and real OSC molecules, greatly outperforming\neight adversarial controls. Collectively, our work not only provides\na quick and reliable tool to screen efficient OSCs but also offers\nmethodological guidelines for improving the generalization of ML.

Publication Details

Journal
Figshare
Published
2024-11-26
DOI
https://doi.org/10.1021/acs.jctc.4c00969.s001
Primary Topic
Mycorrhizal Fungi and Plant Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data-Quality-Navigated\nMachine Learning Strategy with\nChemical Intuition to Improve Generalization

Figshare
Mycorrhizal Fungi and Plant Interactions
article

Data-Quality-Navigated\nMachine Learning Strategy with\nChemical Intuition to Improve Generalization

article en

Abstract

Generalizing real-world data has been one of the most\ndifficult\nchallenges for application of machine learning (ML) in practice. Most\nML works focused on improvements in algorithms and feature representations.\nHowever, the data quality, as the foundation of ML, has been largely\noverlooked, also leading to the absence of data evaluation and processing\nmethods in ML fields. Motivated by the challenge and need, we selected\nan important but difficult reorganization energy (RE) prediction task\nas a test platform, which is an important parameter for the charge\nmobility of organic semiconductors (OSCs), to propose a data-quality-navigated\nstrategy with chemical intuition. We developed a data diversity evaluation\nbased on structure characteristics of OSC molecules, a reliability\nevaluation method based on prediction accuracy, a data filtering method\nbased on the uncertainty of <i>K</i>-fold division, and\na data split technique by clustering and stratified sampling based\non four molecular descriptor-associated REs. Consequently, a representative\nRE data set (15,989 molecules) with high reliability and diversity\ncan be obtained. For the feature representation, a complementary strategy\nis proposed by considering the chemical nature of REs and the structure\ncharacteristics of OCS molecules as well as the model algorithm. In\naddition, an ensemble framework consisting of two deep learning models\nis constructed to avoid the risk of local optimization of the single\nmodel. The robustness and generalization of our model are strongly\nvalidated against different OSC-like molecules with diverse structures\nand a wide range of REs and real OSC molecules, greatly outperforming\neight adversarial controls. Collectively, our work not only provides\na quick and reliable tool to screen efficient OSCs but also offers\nmethodological guidelines for improving the generalization of ML.

Figshare
Openalex Percentile: Top 59%
Mycorrhizal Fungi and Plant Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.