Optimisation and complexity for Gibbs samplers for hierarchical and crossed-effect models
45 mins 16 secs,
659.22 MB,
MPEG-4 Video
640x360,
29.97 fps,
44100 Hz,
1.94 Mbits/sec
Share this media item:
Embed this media item:
Embed this media item:
About this item
| Description: |
Roberts, G
Wednesday 5th July 2017 - 14:15 to 15:00 |
|---|
| Created: | 2017-07-21 16:39 |
|---|---|
| Collection: | Scalable inference; statistical, algorithmic, computational aspects |
| Publisher: | Isaac Newton Institute |
| Copyright: | Roberts, G |
| Language: | eng (English) |
| Distribution: |
World
(downloadable)
|
| Explicit content: | No |
| Aspect Ratio: | 16:9 |
| Screencast: | No |
| Bumper: | UCS Default |
| Trailer: | UCS Default |
| Abstract: | We study the convergence properties of the Gibbs Sampler in the context of Gaussian hierarchical and crossed-effect models. We develop a novel methodology based on multi-grid decompositions to derive analytic expressions for the convergence rates of the algorithm, extending significantly the class of conditionally Gaussian models amenable to direct analysis. In the hierarchical context, our work gives a rather complete understanding of the Gibbs Sampler behaviour for symmetric models (with arbitrary depth), while providing approximations and bounds for the non-symmetric cases. The theoretical results give rise to simple and easy-to-implement guidelines to optimise practical implementations of the Gibbs samplers on such models. While the good performances of the Gibbs Sampler in hierarchically-structured models is renowned, the context of crossed-effect models is drastically different. Here hierarchical centering is not possible and the convergence of commonly implemented Gibbs Sampler strategies deteriorates as the data-size increases, resulting in super-linear computational complexity (potentially even quadratic) in the number of data-points. We show how to leverage the negatively-correlated structure of crossed-effect models to design easy-to-implement collapsed Gibbs Samplers whose complexity matches the one of hierarchical scenarios.
This is joint work with Giacomo Zanella and Omiros Papaspiliopoulos. |
|---|---|
Available Formats
| Format | Quality | Bitrate | Size | |||
|---|---|---|---|---|---|---|
| MPEG-4 Video * | 640x360 | 1.94 Mbits/sec | 659.22 MB | View | Download | |
| WebM | 640x360 | 562.02 kbits/sec | 186.33 MB | View | Download | |
| iPod Video | 480x270 | 522.16 kbits/sec | 173.12 MB | View | Download | |
| MP3 | 44100 Hz | 249.81 kbits/sec | 82.89 MB | Listen | Download | |
| Auto | (Allows browser to choose a format it supports) | |||||