Extreme learning machines with Gaussian random field pretraining

Machine learning has become a powerful tool for solving differential equations, offering numerous advantages over traditional methods.However, the unsupervised training of physicsinformed neural networks (PINNs) can result in non-convex loss landscapes.Extreme learning machines (ELMs) address this by fixing internal weights and biases, requiring only the determination of output weights.Although ELMs offer benefits over PINNs, their reliance on randomized basis functions limits their expressiveness.To enhance expressiveness of the ELMs, we pretrain single-layer feedforward neural networks using Gaussian random fields, improving the quality of the basis functions.This method, termed PT-ELM, demonstrates that pretrained basis functions in ELMs yield accurate solutions for boundary layer problems with better convergence patterns.PT-ELM outperforms both traditional ELMs and the recently developed TransNet models.The PT-ELM approach can be adapted for solving data and physics driven problems to enhance predictive ability of the neural networks.

Authors

Institutions

Publication Details

Published
2024-12-26
DOI
https://doi.org/10.59849/aidd.2024.78
Primary Topic
Machine Learning and ELM
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Extreme learning machines with Gaussian random field pretraining

Hüseyin Tunç
Machine Learning and ELM
article

Extreme learning machines with Gaussian random field pretraining

Hüseyin Tunç
article en

Abstract

Machine learning has become a powerful tool for solving differential equations, offering numerous advantages over traditional methods.However, the unsupervised training of physicsinformed neural networks (PINNs) can result in non-convex loss landscapes.Extreme learning machines (ELMs) address this by fixing internal weights and biases, requiring only the determination of output weights.Although ELMs offer benefits over PINNs, their reliance on randomized basis functions limits their expressiveness.To enhance expressiveness of the ELMs, we pretrain single-layer feedforward neural networks using Gaussian random fields, improving the quality of the basis functions.This method, termed PT-ELM, demonstrates that pretrained basis functions in ELMs yield accurate solutions for boundary layer problems with better convergence patterns.PT-ELM outperforms both traditional ELMs and the recently developed TransNet models.The PT-ELM approach can be adapted for solving data and physics driven problems to enhance predictive ability of the neural networks.

Bahçeşehir University (TR)
Openalex Percentile: Top 78%
Machine Learning and ELM
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Extreme learning machines with Gaussian random field pretraining — Hüseyin Tunç · (2024) | TGRS Research Map | TGRS