Fix leaky ReLU

This commit is contained in:
2024-06-16 17:32:25 +02:00
parent 0adfef313a
commit 27b1947218

View File

@ -371,7 +371,7 @@ The prediction is obtained as the index of the maximum score.
\[
\texttt{leaky\_ReLU}(a) = \begin{cases}
a & \text{if $a \geq 0$} \\
0.01 & \text{otherwise}
0.01 \cdot a & \text{otherwise}
\end{cases} \hspace{2em}
\frac{\partial \texttt{leaky\_ReLU}(a)}{\partial a} = \begin{cases}
1 & \text{if } a \geq 0 \\