More neurons in the hidden layer than predictive features in neural nets
This week, we were talking about neural networks for the first time, and I was saying that, in many illustrations of neural networks, there was a layer with fewer neurons than predictive variables, but sometimes, it could make sense to have more neurons in the layer than predictive variables, To illustrate, consider a simple example with one single variable [latex]x[/latex], and a binary outcome [latex]y\\in\\{0,1\\}[/latex] set.seed(12345) n = 100 x = c(runif(n),1+runif(n),2+runif(n)) y = rep(...
Publication Details
- Journal
- Industrias Culturais (Universidade de Coimbra)
- Published
- 2024-10-25
- DOI
- https://doi.org/10.58079/12ky8
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00