# Energy-based Model

## Energy-based model like Boltzmann machine is a special type of neural networks

#
^{4} Restricted Boltzmann Machine

Published: 2021-06-11

Category: { Energy-based Model }

Tags:

References:
- Mehta P, Bukov M, Wang C-HH, Day AGRR, Richardson C, Fisher CK, et al. A high-bias, low-variance introduction to Machine Learning for physicists. Phys Rep. 2018;810: 122. doi:10.1016/j.physrep.2019.03.001
- Hubbard J. Calculation of Partition Functions. Physical Review Letters. 1959. pp. 77–78. doi:10.1103/physrevlett.3.77
- Contributors to Wikimedia projects. Cumulant. In: Wikipedia [Internet]. 7 May 2021 [cited 18 Jun 2021]. Available: https://en.wikipedia.org/wiki/Cumulant

Summary: Introducing latent variables to Boltzmann machine and restrict the connections within groups.

Pages: 3

#
^{3} Boltzmann Machine

Published: 2017-08-27

Category: { Energy-based Model }

Tags:

References:
- Mehta P, Bukov M, Wang C-HH, Day AGRR, Richardson C, Fisher CK, et al. A high-bias, low-variance introduction to Machine Learning for physicists. Phys Rep. 2018;810: 122. doi:10.1016/j.physrep.2019.03.001
- Hinton GE. Boltzmann Machines. 2007.

Summary: Boltzmann machine is much like a spin glass model in physics. In short words, Boltzmann machine is a machine that has nodes that can take values, and the nodes are connected through some weight. It is just like any other neual nets but with complications and theoretical implications.

Pages: 3

#
^{1} MaxEnt Model

Published: 2021-05-31

Category: { Energy-based Model }

Tags:

Summary: Maximum Entropy models makes least assumption about the data

Pages: 3