Normal-Wishart posteriorunun derivasyonu

Normal-Wishart posteriorunun türetilmesi üzerinde çalışıyorum ama parametrelerden birinde takılı kaldım (ölçek matrisinin posterioru, altta bakınız).

Sadece bağlam ve bütünlük için, işte model ve diğer türevler:

\begin{aligned} x_{i} & \sim N (μ, Λ) \\ μ & \sim N (μ_{0}, (κ_{0} Λ)^{- 1}) \\ Λ & \sim W (υ_{0}, W_{0}) \end{aligned}

$\begin{align} x_i &\sim \mathcal{N}(\boldsymbol{\mu}, \boldsymbol{\Lambda})\\ \boldsymbol{\mu} &\sim \mathcal{N}(\boldsymbol{\mu_0}, (\kappa_0 \boldsymbol{\Lambda})^{-1})\\ \boldsymbol{\Lambda} &\sim \mathcal{W}(\upsilon_0, \mathbf{W}_0) \end{align}$

Üç faktörün her birinin genişletilmiş formları (orantılılık sabitine kadar) şunlardır:

Olabilirlik:
$\begin{aligned} N (x_{i} & | μ, Λ) \propto \\ | Λ |^{N / 2} \exp (- \frac{1}{2} \sum_{i = 1}^{N} (x_{i}^{T} Λ x_{i} - 2 μ^{T} Λ x_{i} + μ^{T} Λ μ)) \end{aligned}$ $\begin{align} \mathcal{N}(\mathbf{x}_i &| \boldsymbol{\mu}, \boldsymbol{\Lambda}) \propto\notag\\ &|\boldsymbol{\Lambda}|^{N/2} \exp{\left(-\frac{1}{2}\sum_{i=1}^N \left( \mathbf{x}_i^T\boldsymbol{\Lambda}\mathbf{x}_i - 2 \boldsymbol{\mu}^T \boldsymbol{\Lambda}\mathbf{x}_i + \boldsymbol{\mu}^T\boldsymbol{\Lambda}\boldsymbol{\mu}\right) \right)} \end{align}$
Normal önce:
$\begin{aligned} N (μ & | (μ_{0}, κ_{0} Λ)^{- 1}) \propto \\ | Λ |^{1 / 2} \exp (- \frac{1}{2} (μ^{T} κ_{0} Λ μ - 2 μ^{T} κ_{0} Λ μ_{0} + μ_{0}^{T} κ_{0} Λ μ_{0})) \end{aligned}$ $\begin{align} \mathcal{N}(\boldsymbol{\mu} &| (\boldsymbol{\mu}_0, \kappa_0 \boldsymbol{\Lambda})^{-1}) \propto\notag\\ &|\boldsymbol{\Lambda}|^{1/2} \exp{\left(-\frac{1}{2}\left( \boldsymbol{\mu}^T\kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu} - 2 \boldsymbol{\mu}^T \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu_0} + \boldsymbol{\mu_0}^T \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu_0}\right) \right)} \end{align}$
Önceden Wishart:
$\begin{aligned} W (Λ | υ_{0}, W_{0}) \propto | Λ |^{\frac{υ_{0} - D - 1}{2}} \exp (- \frac{1}{2} t r (W_{0}^{- 1} Λ)) \end{aligned}$ $\begin{align} \mathcal{W}(\boldsymbol{\Lambda} | \upsilon_0, \mathbf{W}_0) \propto |\boldsymbol{\Lambda}|^{\frac{\upsilon_0-D-1}{2}} \exp{\left(-\frac{1}{2} tr(\mathbf{W}_0^{-1} \boldsymbol{\Lambda})\right)} \end{align}$

Ayrıştırılabilen arka Normal-Wishart ( ) istiyoruz ayrıca : $\mathbf{\mu}, \boldsymbol{\Lambda} | \boldsymbol{\mu}', \kappa', \upsilon', \mathbf{W}'$ $\mathcal{N}(\boldsymbol{\mu} | \boldsymbol{\mu}, \kappa' \boldsymbol{\Lambda}) \mathcal{W}(\boldsymbol{\Lambda} | \upsilon', \mathbf{W}')$

Özgürlüğün bozulması $\upsilon'$

Olasılığın ilk faktörlerini ve Wishart'ı birleştirerek, Wishart faktörünün ilk faktörünü posteriorda alırız: ve bu nedenle posteriorun ilk parametresine sahibiz:

\begin{aligned} | Λ |^{\frac{υ_{0} + N - D - 1}{2}} \end{aligned}

$\begin{align} |\boldsymbol{\Lambda}|^{\frac{\upsilon_0+N-D-1}{2}} \end{align}$

\begin{aligned} υ^{'} = υ_{0} + N \end{aligned}

$\begin{align} \upsilon' = \upsilon_0 +N \end{align}$

Ölçek faktörü $\kappa'$

ve ile çevrili öğeleri önceden nın kim tarafından güncellendiğini bulmak için : ve bu nedenle ikinci parametreyi aldık: $\boldsymbol{\mu}^T$ $\boldsymbol{\mu}$ $\kappa_0 \boldsymbol{\Lambda}$

\begin{aligned} μ^{T} ((κ_{0} + N) Λ) μ \end{aligned}

$\begin{align} \boldsymbol{\mu}^T\left((\kappa_0 + N) \boldsymbol{\Lambda}\right)\boldsymbol{\mu} \end{align}$

\begin{aligned} κ^{'} = κ_{0} + N \end{aligned}

$\begin{align} \kappa' = \kappa_0 + N \end{align}$

Ortalama $\boldsymbol{\mu}'$

Üçüncü parametre içeride ne tanımlayan gelen : Ve bu nedenle üçüncü parametreyi aldık: $2\boldsymbol{\mu}^T...$

\begin{aligned} 2 μ^{T} (Λ N \bar{x} + κ_{0} Λ μ_{0}) & = 2 μ^{T} κ^{'} Λ μ^{'} \\ (Λ N \bar{x} + κ_{0} Λ μ_{0}) & = κ^{'} Λ μ^{'} \\ (N \bar{x} + κ_{0} μ_{0}) & = κ^{'} μ^{'} \end{aligned}

$\begin{align} 2\boldsymbol{\mu}^T\left(\boldsymbol{\Lambda} N \mathbf{\overline{x} + \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu}_0}\right) &= 2\boldsymbol{\mu}^T \kappa'\boldsymbol{\Lambda} \boldsymbol{\mu}'\\ \left(\boldsymbol{\Lambda} N \mathbf{\overline{x} + \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu}_0}\right) &= \kappa'\boldsymbol{\Lambda} \boldsymbol{\mu}'\\ \left(N \mathbf{\overline{x} + \kappa_0 \boldsymbol{\mu}_0}\right) &= \kappa' \boldsymbol{\mu}' \end{align}$

\begin{aligned} μ^{'} = \frac{1}{k^{'}} (N \bar{x} + κ_{0} μ_{0}) \end{aligned}

$\begin{align} \boldsymbol{\mu}' = \frac{1}{k'}(N\mathbf{\overline{x}} + \kappa_0 \boldsymbol{\mu}_0) \end{align}$

Ölçek matrisi $\boldsymbol{W}'$

Ve dördüncü parametre kalan parametreler üzerinde çalışmaktan gelir:

\begin{aligned} t r (W^{' - 1} Λ) & = t r (W_{0}^{- 1} Λ) + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + μ_{0}^{T} κ_{0} Λ μ_{0} \\ = t r (W_{0}^{- 1} Λ) + \sum_{i = 1}^{N} t r (x_{i}^{T} Λ x_{i}) + t r (μ_{0}^{T} κ_{0} Λ μ_{0}) \\ = t r (W_{0}^{- 1} Λ + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + μ_{0}^{T} κ_{0} Λ μ_{0}) \end{aligned}

$\begin{align} tr(\mathbf{W}'^{-1} \boldsymbol{\Lambda}) &= tr(\mathbf{W}_0^{-1} \boldsymbol{\Lambda}) + \sum_{i=1}^{N}\mathbf{x}_i^T\boldsymbol{\Lambda}\mathbf{x}_i + \boldsymbol{\mu_0}^T \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu_0}\\ &= tr(\mathbf{W}_0^{-1} \boldsymbol{\Lambda}) + \sum_{i=1}^{N}tr(\mathbf{x}_i^T\boldsymbol{\Lambda}\mathbf{x}_i) + tr(\boldsymbol{\mu_0}^T \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu_0})\\ &= tr\bigg(\mathbf{W}_0^{-1} \boldsymbol{\Lambda} + \sum_{i=1}^{N}\mathbf{x}_i^T\boldsymbol{\Lambda}\mathbf{x}_i + \boldsymbol{\mu_0}^T \kappa_0 \boldsymbol{\Lambda}\boldsymbol{\mu_0}\bigg) \end{align}$

Buradan nasıl devam edeceğim (şimdiye kadar hiç hata yapmadıysam) ve için standart çözümü nasıl edinebilirim ? $\mathbf{W}'$

Düzenleme 1 :

Şimdi standart çözümde olduğu gibi iki kare elde etmek için terimleri yeniden düzenliyoruz, bazı faktörleri ekliyor ve özetliyoruz:

\begin{aligned} t r (W^{' - 1} Λ) = & t r (W^{- 1} Λ \\ + \sum_{i = 1}^{N} (x_{i}^{T} Λ x_{i} + {\bar{x}}^{T} Λ \bar{x} - 2 x_{i}^{T} Λ \bar{x}) \\ + κ_{0} (μ_{0}^{T} Λ μ_{0} + {\bar{x}}^{T} Λ \bar{x} - 2 {\bar{x}}^{T} Λ μ_{0}) \\ - \sum_{i = 1}^{N} {\bar{x}}^{T} Λ \bar{x} + 2 \sum_{i = 1}^{N} x_{i}^{T} Λ \bar{x} - κ_{0} {\bar{x}}^{T} Λ \bar{x} + 2 κ_{0} {\bar{x}}^{T} Λ μ_{0}) \\ = & t r (W^{- 1} Λ + \sum_{i = 1}^{N} (x_{i} - \bar{x}) Λ (x_{i} - \bar{x})^{T} + κ_{0} (\bar{x} - μ_{0}) Λ (\bar{x} - μ_{0})^{T} \\ - N \bar{x} Λ {\bar{x}}^{T} + 2 N \bar{x} Λ {\bar{x}}^{T} - κ_{0} \bar{x} Λ {\bar{x}}^{T} + 2 κ_{0} \bar{x} Λ μ_{0}^{T}) \end{aligned}

$\begin{align} tr(\mathbf{W}'^{-1}\boldsymbol{\Lambda}) =\;& tr\bigg(\mathbf{W}^{-1} \boldsymbol{\Lambda}\\ &+ \sum_{i=1}^N (\mathbf{x}_i^T \boldsymbol{\Lambda} \mathbf{x}_i + \overline{\mathbf{x}}^T \boldsymbol{\Lambda} \overline{\mathbf{x}} -2 \mathbf{x}_i^T \boldsymbol{\Lambda} \mathbf{\overline{x}})\\ &+\kappa_0 (\boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + \boldsymbol{\overline{x}}^T \boldsymbol{\Lambda}\boldsymbol{\overline{x}} - 2\boldsymbol{\overline{x}}^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0) \notag\\% Substract added factors &-\sum_{i=1}^{N}\overline{\mathbf{x}}^T \boldsymbol{\Lambda} \overline{\mathbf{x}} +2\sum_{i=1}^{N}\mathbf{x}_i^T \boldsymbol{\Lambda} \mathbf{\overline{x}} - \kappa_0\boldsymbol{\overline{x}}^T \boldsymbol{\Lambda} \boldsymbol{\overline{x}} + 2\kappa_0\boldsymbol{\overline{x}}^T \boldsymbol{\Lambda}\boldsymbol{\mu}_0\bigg)\\ =\;& tr\bigg( \mathbf{W}^{-1} \boldsymbol{\Lambda}+ \sum_{i=1}^N (\mathbf{x}_i - \overline{\mathbf{x}})\boldsymbol{\Lambda}(\mathbf{x}_i - \overline{\mathbf{x}})^T + \kappa_0(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)\boldsymbol{\Lambda}(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)^T \notag\\% Substract added factors &-N\overline{\mathbf{x}} \boldsymbol{\Lambda} \overline{\mathbf{x}}^T +2N\mathbf{\overline{x}} \boldsymbol{\Lambda}\mathbf{\overline{x}}^T - \kappa_0\boldsymbol{\overline{x}}\boldsymbol{\Lambda}\boldsymbol{\overline{x}}^T + 2\kappa_0\boldsymbol{\overline{x}}\boldsymbol{\Lambda} \boldsymbol{\mu}_0^T \bigg) \end{align}$

Karelerin dışında kalan faktörleri basitleştiririz:

\begin{aligned} t r (W^{' - 1} Λ) = & t r (W^{- 1} Λ + \sum_{i = 1}^{N} (x_{i} - \bar{x})^{T} Λ (x_{i} - \bar{x}) + κ_{0} (\bar{x} - μ_{0})^{T} Λ (\bar{x} - μ_{0}) \\ + (N - κ_{0}) {\bar{x}}^{T} Λ \bar{x} + 2 κ_{0} {\bar{x}}^{T} Λ μ_{0}) \end{aligned}

$\begin{align} tr(\mathbf{W}'^{-1} \boldsymbol{\Lambda}) =\;& tr( \mathbf{W}^{-1} \boldsymbol{\Lambda}+ \sum_{i=1}^N (\mathbf{x}_i - \overline{\mathbf{x}})^T\boldsymbol{\Lambda}(\mathbf{x}_i - \overline{\mathbf{x}}) + \kappa_0(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)^T\boldsymbol{\Lambda}(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0) \notag\\% Substract added factors & +(N - \kappa_0)\mathbf{\overline{x}}^T\boldsymbol{\Lambda} \mathbf{\overline{x}} + 2\kappa_0\boldsymbol{\overline{x}}^T\boldsymbol{\Lambda}\boldsymbol{\mu}_0 \bigg) \end{align}$

Edit 2 ( @bdeonovic'in cevabı sayesinde takip )

İz döngüseldir, bu nedenle . Ardından: ve sonra: $tr(ABC) = tr(BCA) = tr(CAB)$

\begin{aligned} t r (W^{' - 1} Λ) = & t r (W^{- 1} Λ + \sum_{i = 1}^{N} (x_{i} - \bar{x}) (x_{i} - \bar{x})^{T} Λ + κ_{0} (\bar{x} - μ_{0}) (\bar{x} - μ_{0})^{T} Λ \\ + (N - κ_{0}) \bar{x} {\bar{x}}^{T} Λ + 2 κ_{0} \bar{x} μ_{0}^{T} Λ) \end{aligned}

$\begin{align} tr(\mathbf{W}'^{-1} \boldsymbol{\Lambda}) =\;& tr\bigg( \mathbf{W}^{-1} \boldsymbol{\Lambda}+ \sum_{i=1}^N (\mathbf{x}_i - \overline{\mathbf{x}})(\mathbf{x}_i - \overline{\mathbf{x}})^T\boldsymbol{\Lambda} + \kappa_0(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)^T\boldsymbol{\Lambda} \notag\\% Substract added factors & +(N - \kappa_0)\mathbf{\overline{x}} \mathbf{\overline{x}}^T\boldsymbol{\Lambda} + 2\kappa_0\boldsymbol{\overline{x}}\boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \bigg) \end{align}$

\begin{aligned} t r (W^{' - 1}) = & t r (W^{- 1} + \sum_{i = 1}^{N} (x_{i} - \bar{x}) (x_{i} - \bar{x})^{T} + κ_{0} (\bar{x} - μ_{0}) (\bar{x} - μ_{0})^{T} \\ + (N - κ_{0}) \bar{x} {\bar{x}}^{T} + 2 κ_{0} \bar{x} μ_{0}^{T}) \end{aligned}

$\begin{align} tr(\mathbf{W}'^{-1}) =\;& tr\bigg( \mathbf{W}^{-1}+ \sum_{i=1}^N (\mathbf{x}_i - \overline{\mathbf{x}})(\mathbf{x}_i - \overline{\mathbf{x}})^T + \kappa_0(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)^T \notag\\% Substract added factors & +(N - \kappa_0)\mathbf{\overline{x}} \mathbf{\overline{x}}^T + 2\kappa_0\boldsymbol{\overline{x}}\boldsymbol{\mu}_0^T \bigg) \end{align}$

Neredeyse! Ama hala orada değil. Amaç:

\begin{aligned} W^{- 1} + \sum_{i = 1}^{N} (x_{i} - \bar{x}) (x_{i} - \bar{x})^{T} + \frac{κ_{0} N}{κ_{0} + N} (\bar{x} - μ_{0}) (\bar{x} - μ_{0})^{T} \end{aligned}

$\begin{align} \mathbf{W}^{-1} + \sum_{i=1}^N (\mathbf{x}_i - \overline{\mathbf{x}})(\mathbf{x}_i - \overline{\mathbf{x}})^T + \frac{\kappa_0 N}{\kappa_0 + N}(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)(\boldsymbol{\overline{x}} - \boldsymbol{\mu}_0)^T \end{align}$

bayesian posterior

— alberto
kaynak

Yanıtlar:

İz döngüseldir, bu nedenle . Ayrıca eser ekleme üzerine dağıtılır böylece . Bu gerçeklerle terimini izleme terimlerinde arkaya çevirebilmeli, izleme terimlerini birlikte birleştirebilmelisiniz. Sonuç $tr(ABC) = tr(BCA) = tr(CAB)$ $tr(A+B) = tr(A) + tr(B)$ $\Lambda$

W^{' - 1} = W^{- 1} + \sum_{i = 1}^{N} x_{i} x_{i}^{⊺} + μ_{0} μ_{0}^{⊺}

$W'^{-1} = W^{-1} + \sum_{i=1}^N x_i x_i^\intercal + \mu_0\mu_0^\intercal$

— bdeonovic
kaynak

Teşekkürler! henüz, ve içeren standart sonuçlara ( en.wikipedia.org/wiki/Conjugate_prior ) nasıl . Olumsuz işaretlerim bile yok: O

\sum (x_{i} - \bar{x})

$\sum(x_i-\overline{x})$

\bar{x} - μ_{0}

$\overline{x} - \mu_0$

— alberto

önceki olasılık $\times$

| Λ |^{N / 2} \exp {- \frac{1}{2} (\sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} - N {\bar{x}}^{T} Λ μ - μ^{T} Λ N \bar{x} + N μ^{T} Λ μ)} \times | Λ |^{(ν_{0} - D - 1) / 2} \exp {- \frac{1}{2} t r (W_{0}^{- 1} Λ)} \times | Λ |^{1 / 2} \exp {- \frac{κ_{0}}{2} (μ^{T} Λ μ - μ^{T} Λ μ_{0} - μ_{0}^{T} Λ μ + μ_{0}^{T} Λ μ_{0})} .

$|\boldsymbol{\Lambda}|^{N/2} \exp\left\{-\frac{1}{2}\left(\sum_{i=1}^N \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{x}_i - N\boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\mu} - \boldsymbol{\mu}^T \boldsymbol{\Lambda} N\boldsymbol{\bar{x}} + N\boldsymbol{\mu}^T \boldsymbol{\Lambda} \boldsymbol{\mu} \right) \right\} \\ \times |\boldsymbol{\Lambda}|^{(\nu_0 - D - 1)/2} \exp\left\{-\frac{1}{2} tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right) \right\} \\ \times |\boldsymbol{\Lambda}|^{1/2} \exp \left\{ -\frac{\kappa_0}{2} \left( \boldsymbol{\mu}^T \boldsymbol{\Lambda} \boldsymbol{\mu} - \boldsymbol{\mu}^T\boldsymbol{\Lambda} \boldsymbol{\mu}_0 - \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu} + \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 \right) \right\}.$ Bu, olarak yeniden yazılabilir Yeniden yazabiliriz

| Λ |^{1 / 2} | Λ |^{(ν_{0} + N - D - 1) / 2} \times \exp {- \frac{1}{2} ((κ_{0} + N) μ^{T} Λ μ - μ^{T} Λ (κ_{0} μ_{0} + N \bar{x}) - (κ_{0} μ_{0} + N \bar{x})^{T} Λ μ + κ_{0} μ_{0}^{T} Λ μ_{0} + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + t r (W_{0}^{- 1} Λ))}

$|\boldsymbol{\Lambda}|^{1/2} |\boldsymbol{\Lambda}|^{(\nu_0 + N - D - 1)/2} \\ \times \exp \left\{ -\frac{1}{2} \left( \left(\kappa_0 + N\right) \boldsymbol{\mu}^T \boldsymbol{\Lambda} \boldsymbol{\mu} - \boldsymbol{\mu}^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) - (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} \boldsymbol{\mu} \\ + \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + \sum_{i=1}^N \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{x}_i + tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right) \right) \right\}$

(κ_{0} + N) μ^{T} Λ μ - μ^{T} Λ (κ_{0} μ_{0} + N \bar{x}) - (κ_{0} μ_{0} + N \bar{x})^{T} Λ μ + κ_{0} μ_{0}^{T} Λ μ_{0} + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + t r (W_{0}^{- 1} Λ)

(κ_{0} + N) μ^{T} Λ μ - μ^{T} Λ (κ_{0} μ_{0} + N \bar{x}) - (κ_{0} μ_{0} + N \bar{x})^{T} Λ μ + \frac{1}{κ_{0} + N} (κ_{0} μ_{0} + N \bar{x})^{T} Λ (κ_{0} μ_{0} + N \bar{x}) - \frac{1}{κ_{0} + N} (κ_{0} μ_{0} + N \bar{x})^{T} Λ (κ_{0} μ_{0} + N \bar{x}) + κ_{0} μ_{0}^{T} Λ μ_{0} + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + t r (W_{0}^{- 1} Λ) .

$(\kappa_0 + N) \boldsymbol{\mu}^T \boldsymbol{\Lambda} \boldsymbol{\mu} - \boldsymbol{\mu}^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) - (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} \boldsymbol{\mu} \\ + \frac{1}{\kappa_0 + N}(\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) \\ - \frac{1}{\kappa_0 + N}(\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) \\ + \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + \sum_{i=1}^N \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{x}_i + tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right).$ En üstteki iki satır şimdi

(κ_{0} + N) {(μ - \frac{κ_{0} μ + N \bar{x}}{κ_{0} + N})}^{T} Λ (μ - \frac{κ_{0} μ + N \bar{x}}{κ_{0} + N}) .

$(\kappa_0 + N) \left( \boldsymbol{\mu} - \frac{\kappa_0 \boldsymbol{\mu} + N \boldsymbol{\bar{x}}}{\kappa_0 + N} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\mu} - \frac{\kappa_0 \boldsymbol{\mu} + N \boldsymbol{\bar{x}}}{\kappa_0 + N} \right).$

toplama ve çıkarma , aşağıdakiler: olarak yeniden yazılabilir $N \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}}$

- \frac{1}{κ_{0} + N} (κ_{0} μ_{0} + N \bar{x})^{T} Λ (κ_{0} μ_{0} + N \bar{x}) + κ_{0} μ_{0}^{T} Λ μ_{0} + \sum_{i = 1}^{N} x_{i}^{T} Λ x_{i} + t r (W_{0}^{- 1} Λ)

$- \frac{1}{\kappa_0 + N}(\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) + \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + \sum_{i=1}^N \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{x}_i + tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right)$

\sum_{i = 1}^{N} (x_{i}^{T} Λ x_{i} - x_{i}^{T} Λ \bar{x} - {\bar{x}}^{T} Λ x_{i} + {\bar{x}}^{T} Λ \bar{x}) + N {\bar{x}}^{T} Λ \bar{x} + κ_{0} μ_{0}^{T} Λ μ_{0} - \frac{1}{κ_{0} + N} (κ_{0} μ_{0} + N \bar{x})^{T} Λ (κ_{0} μ_{0} + N \bar{x}) + t r (W_{0}^{- 1} Λ) .

$\sum_{i=1}^N \left( \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{x}_i - \boldsymbol{x}_i^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} - \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{x}_i + \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} \right) + N \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} + \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 - \frac{1}{\kappa_0 + N}(\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}})^T \boldsymbol{\Lambda} (\kappa_0 \boldsymbol{\mu}_0 + N \boldsymbol{\bar{x}}) + tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right).$ Toplam terim

\sum_{i = 1}^{N} (x_{i}^{T} Λ x_{i} - x_{i}^{T} Λ \bar{x} - {\bar{x}}^{T} Λ x_{i} + {\bar{x}}^{T} Λ \bar{x})

\sum_{i = 1}^{N} {(x_{i} - \bar{x})}^{T} Λ (x_{i} - \bar{x}) .

$\sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right).$

N {\bar{x}}^{T} Λ \bar{x} + κ_{0} μ_{0}^{T} Λ μ_{0} - \frac{1}{κ_{0} + N} (κ_{0} μ_{0} + N \bar{x})^{T} Λ (κ_{0} μ_{0} + N \bar{x})

N {\bar{x}}^{T} Λ \bar{x} + κ_{0} μ_{0}^{T} Λ μ_{0} - \frac{1}{κ_{0} + N} (κ_{0}^{2} μ_{0}^{T} Λ μ_{0} + N κ_{0} μ_{0}^{T} Λ {\bar{x}}_{0} + N κ_{0} {\bar{x}}^{T} Λ μ_{0} + N^{2} {\bar{x}}^{T} Λ \bar{x}),

$N \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} + \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 - \frac{1}{\kappa_0 + N}(\kappa_0^2 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + N \kappa_0 \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}}_0 + N \kappa_0 \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 + N^2 \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}}),$ bu eşittir

\frac{N κ_{0}}{κ_{0} + N} ({\bar{x}}^{T} Λ \bar{x} - {\bar{x}}^{T} Λ μ_{0} - μ_{0}^{T} Λ \bar{x} + μ_{0}^{T} Λ μ_{0}) = \frac{N κ_{0}}{κ_{0} + N} {(\bar{x} - μ_{0})}^{T} Λ (\bar{x} - μ_{0}) .

$\frac{N\kappa_0}{\kappa_0 + N} \left( \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} - \boldsymbol{\bar{x}}^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 - \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\bar{x}} + \boldsymbol{\mu}_0^T \boldsymbol{\Lambda} \boldsymbol{\mu}_0 \right) = \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right).$

Aşağıdaki iki terim skalerdir: Ve herhangi bir skaler izine eşittir, bu yüzden

\sum_{i = 1}^{N} {(x_{i} - \bar{x})}^{T} Λ (x_{i} - \bar{x}), \frac{N κ_{0}}{κ_{0} + N} {(\bar{x} - μ_{0})}^{T} Λ (\bar{x} - μ_{0}) .

$\sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right), \thinspace \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right).$

t r (W_{0}^{- 1} Λ) + \sum_{i = 1}^{N} {(x_{i} - \bar{x})}^{T} Λ (x_{i} - \bar{x}) + \frac{N κ_{0}}{κ_{0} + N} {(\bar{x} - μ_{0})}^{T} Λ (\bar{x} - μ_{0})

$tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right) + \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) + \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)$ gibi yazılabilir Yana , yukarıda toplamı eşittir

t r (W_{0}^{- 1} Λ) + t r (\sum_{i = 1}^{N} {(x_{i} - \bar{x})}^{T} Λ (x_{i} - \bar{x})) + t r (\frac{N κ_{0}}{κ_{0} + N} {(\bar{x} - μ_{0})}^{T} Λ (\bar{x} - μ_{0})) .

$tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right) + tr \left( \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) \right) + tr \left( \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right) \right).$

t r (A B C) = t r (C A B)

$tr(\boldsymbol{A} \boldsymbol{B} \boldsymbol{C}) = tr(\boldsymbol{C} \boldsymbol{A} \boldsymbol{B})$

t r (W_{0}^{- 1} Λ) + t r (\sum_{i = 1}^{N} (x_{i} - \bar{x}) {(x_{i} - \bar{x})}^{T} Λ) + t r (\frac{N κ_{0}}{κ_{0} + N} (\bar{x} - μ_{0}) {(\bar{x} - μ_{0})}^{T} Λ) .

$tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} \right) + tr \left( \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} \right) + tr \left( \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right) \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \right).$ gerçeğini kullanarak toplamı şu şekilde yeniden yazabiliriz:

t r (A + B) = t r (A) + t r (B)

$tr(\boldsymbol{A} + \boldsymbol{B}) = tr(\boldsymbol{A}) + tr(\boldsymbol{B})$

t r (W_{0}^{- 1} Λ + \sum_{i = 1}^{N} (x_{i} - \bar{x}) {(x_{i} - \bar{x})}^{T} Λ + \frac{N κ_{0}}{κ_{0} + N} (\bar{x} - μ_{0}) {(\bar{x} - μ_{0})}^{T} Λ) = t r ((W_{0}^{- 1} + \sum_{i = 1}^{N} (x_{i} - \bar{x}) {(x_{i} - \bar{x})}^{T} + \frac{N κ_{0}}{κ_{0} + N} (\bar{x} - μ_{0}) {(\bar{x} - μ_{0})}^{T}) Λ) .

$tr \left( \boldsymbol{W}_0^{-1} \boldsymbol{\Lambda} + \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T \boldsymbol{\Lambda} + \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right) \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \boldsymbol{\Lambda} \right) = tr \left( \left( \boldsymbol{W}_0^{-1} + \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T + \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right) \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \right) \boldsymbol{\Lambda} \right).$

Hepsini bir araya getirmek, nin önceki olasılığın eşit olduğuna $\boldsymbol{S} = \sum_{i=1}^N \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right) \left( \boldsymbol{x}_i - \boldsymbol{\bar{x}} \right)^T$ $\times$

| Λ |^{1 / 2} \exp {- \frac{κ_{0} + N}{2} {(μ - \frac{κ_{0} μ + N \bar{x}}{κ_{0} + N})}^{T} Λ (μ - \frac{κ_{0} μ + N \bar{x}}{κ_{0} + N})} \times | Λ |^{(ν_{0} + N - D - 1) / 2} \exp {- \frac{1}{2} t r ((W_{0}^{- 1} + S + \frac{N κ_{0}}{κ_{0} + N} (\bar{x} - μ_{0}) {(\bar{x} - μ_{0})}^{T}) Λ)},

$|\boldsymbol{\Lambda}|^{1/2} \exp \left\{-\frac{\kappa_0 + N}{2} \left( \boldsymbol{\mu} - \frac{\kappa_0 \boldsymbol{\mu} + N \boldsymbol{\bar{x}}}{\kappa_0 + N} \right)^T \boldsymbol{\Lambda} \left( \boldsymbol{\mu} - \frac{\kappa_0 \boldsymbol{\mu} + N \boldsymbol{\bar{x}}}{\kappa_0 + N} \right) \right\} \\ \times |\boldsymbol{\Lambda}|^{(\nu_0 + N - D - 1)/2} \exp \left\{ - \frac{1}{2} tr \left( \left( \boldsymbol{W}_0^{-1} + \boldsymbol{S} + \frac{N\kappa_0}{\kappa_0 + N}\left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right) \left( \boldsymbol{\bar{x}} - \boldsymbol{\mu}_0 \right)^T \right) \boldsymbol{\Lambda} \right) \right\},$ gerektiği gibi.

— Alex
kaynak

Normal-Wishart posteriorunun derivasyonu

Özgürlüğün bozulmasıυ′υ′\upsilon'

Ölçek faktörüκ′κ′\kappa'

Ortalamaμ′μ′\boldsymbol{\mu}'

Ölçek matrisiW′W′\boldsymbol{W}'

Özgürlüğün bozulması $\upsilon'$

Ölçek faktörü $\kappa'$

Ortalama $\boldsymbol{\mu}'$

Ölçek matrisi $\boldsymbol{W}'$