AI

Gaussian Naive Bayes

Bayes Rule

$$ P(y \mid \mathbf{X}) \propto P(\mathbf{X} \mid y)\,P(y) \\[6pt]$$

Naive independence assumption:

$$ P(\mathbf{X} \mid y) = \prod_{j=1}^{d} P(x_j \mid y) \\[6pt] $$

Gaussian likelihood:

$$ P(x_j \mid y = k) = \frac{1}{\sqrt{2\pi\sigma_{kj}^2}} \exp\!\left(-\frac{(x_j - \mu_{kj})^2}{2\sigma_{kj}^2}\right) \\[8pt] $$

Parameter estimation:

$$\mu_{kj} = \frac{1}{N_k}\sum_{i:y_i=k} x_{ij}$$

$$\sigma_{kj}^2 = \frac{1}{N_k}\sum_{i:y_i=k}(x_{ij}-\mu_{kj})^2, \quad$$

$$P(y=k)=\frac{N_k}{N}$$

x1 x2 Class x1 x2 Class
53c167c2
54c187c2
55c196c2
57c1107c2
59c1118c2

Predict

x1 x2 Class
104?
512?