The Learning Problem
#Learning Theory
The learning problem posed by Vapnik:^{1}
 Given a sample: $\{z_i\}$ in the probability space $Z$;
 Assuming a probability measure on the probability space $Z$;
 Assuming a set of functions $Q(z, \alpha)$ (e.g. loss functions), where $\alpha$ is a set of parameters;
 A risk functional to be minimized by tunning “the handles” $\alpha$, $R(\alpha)$.
The risk functional is
$$ R(\alpha) = \int Q(z, \alpha) \,\mathrm d F(z). $$
A learning problem is the minimization of this risk.
L Ma (2021). 'The Learning Problem', Datumorphism, 05 April. Available at: https://datumorphism.leima.is/cards/machinelearning/learningtheories/learningproblem/.
Current Ref:

cards/machinelearning/learningtheories/learningproblem.md
Links to:
ERM: Empirical Risk Minimization
In a learning problem The Learning Problem The learning problem posed by Vapnik:1 Given a sample: …
SRM: Structural Risk Minimization
ERM ERM: Empirical Risk Minimization In a learning problem The Learning Problem The learning …
VC Dimension
Two of the key elements in a learning problem are: a set of hypothesis $\mathcal H$, and a set of …
Links from:
Machine Learning Overview
A brief overview of machine learning
Cross Validation
Cross validation is a method to estimate the risk The Learning Problem The learning problem posed …
ERM: Empirical Risk Minimization
In a learning problem The Learning Problem The learning problem posed by Vapnik:1 Given a sample: …
SRM: Structural Risk Minimization
ERM ERM: Empirical Risk Minimization In a learning problem The Learning Problem The learning …