notxia/unibo-ai-notes
1
0
Fork 0
mirror of https://github.com/NotXia/unibo-ai-notes.git synced 2025-12-15 02:52:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

Fix leaky ReLU

Browse Source
This commit is contained in:
Tian Cheng (Riccardo) Xia
2024-06-16 17:32:25 +02:00
parent 0adfef313a
commit 27b1947218
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/year1/image-processing-and-computer-vision/module2/sections/_classification.tex
View File

@ -371,7 +371,7 @@ The prediction is obtained as the index of the maximum score.
\[ \[
\texttt{leaky\_ReLU}(a) = \begin{cases} \texttt{leaky\_ReLU}(a) = \begin{cases}
a & \text{if $a \geq 0$} \\ a & \text{if $a \geq 0$} \\
0.01 & \text{otherwise} 0.01 \cdot a & \text{otherwise}
\end{cases} \hspace{2em} \end{cases} \hspace{2em}
\frac{\partial \texttt{leaky\_ReLU}(a)}{\partial a} = \begin{cases} \frac{\partial \texttt{leaky\_ReLU}(a)}{\partial a} = \begin{cases}
1 & \text{if } a \geq 0 \\ 1 & \text{if } a \geq 0 \\