Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
Loïc Barrault
supports_cours
Commits
54f312e5
Commit
54f312e5
authored
Apr 25, 2019
by
Loïc Barrault
Browse files
minor change
parent
00af54a4
Changes
1
Hide whitespace changes
Inline
Side-by-side
SequenceModeling/unconditional_lm_en.tex
View file @
54f312e5
...
...
@@ -74,7 +74,7 @@
%\begin{varblock}[7cm]{RdN Feedforward}
\begin{description}
\item
[5 .]
Calculate non-normalized score
\item
[\ra]
$
\vm
{
z
}
=
\vm
{
S
}^
\top
~
\vm
{
d
}
+
\vm
{
b
_
S
}
$
~~~
{
\small
avec
$
\vm
{
b
_
S
}$
the bias
}
\item
[\ra]
$
\vm
{
z
}
=
\vm
{
S
}^
\top
~
\vm
{
d
}
+
\vm
{
b
_
S
}
$
~~~
{
\small
with
$
\vm
{
b
_
S
}$
the bias
}
\item
[]
\item
[6 .]
Calculate probability using
\alert
{
softmax
}
\item
[\ra]
$
p
(
w
_
i
=
j |
\cdots
)
=
\ds
\frac
{
e
^{
z
_
j
}}{
\ds
\sum
_{
k
=
1
}^{
\|
V
\|
}
e
^{
z
_
k
}}$
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment