#损失景观

2 stories · 1 in 7 days · 1 in 30 days

ReLU 1 teacher-student 1 tree tensor networks 1 学习理论 1 机器学习 1 梯度下降 1

Stories, products and papers tagged "损失景观", newest first.

Nov 2

Papers Builders12:38

Chinese content两层 ReLU 神经元梯度下降的全局景观与分岔动力学分析

一篇理论论文，用最简单的两神经元 ReLU 模型解释了梯度下降为什么会先合并再分化，做神经网络理论研究的可以看看证明思路。

#ReLU #梯度下降 #损失景观 #teacher-student

arXiv cs.LG@Binghua Li et al. (4)Source

Sep 14

Papers BuildersSelected10:00

Benign Loss Landscapes in Tree Tensor Networks

This paper provides a theoretical framework for understanding why deep neural networks can learn well despite containing hard-to-learn targets, a key question in machine learning research.

#tree tensor networks #loss landscape #gradient descent #computational hardness

arXiv cs.LG@Zach Furman et al. (4)Source