Normalization - Tag - Zayn's Bloghttps://main--zaynblog.netlify.app/tags/normalization-/Normalization - Tag - Zayn's BlogHugo -- gohugo.ioenThis work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Fri, 03 Jan 2025 09:54:54 +0800Batch Normalization 与 Layer Normalizationhttps://main--zaynblog.netlify.app/normalization/Fri, 03 Jan 2025 09:54:54 +0800Yuze Gaohttps://main--zaynblog.netlify.app/normalization/Normalization公式如下 $$ y=\frac{x-E[x]}{\sqrt{Var[x]+\epsilon}} \star \gamma + \beta $$

1.Batch Normalization 与 Layer Normalization

主要区别：

Normalization方向不同，BN是一种“列缩放”，LN是一种“行缩放”

]]>