Next: Expectations
Up: Building Blocks for Variational
Previous: Summary of the updating
Equations (20)-(24) for the addition and
multiplication nodes are proven in the following section. Only the Equation
(20) applies in general, the others assume that the
incoming signals are independent a posteriori. That is,
. Also the proof of the
form of the cost function mostly concerns propagation through addition
and multiplication nodes, so it is presented here. Finally, the
formulas of propagating the gradients of the cost function w.r.t. the
expectations are derived.
Subsections
Tapani Raiko
2006-08-28