Session: | Machine Learning for Image and Video Coding |
Location: | Lecture Room |
Session Time: | Monday, June 25, 10:20 - 12:40 |
Presentation Time: | Monday, June 25, 12:20 - 12:40 |
Presentation: |
Special Session Lecture
|
Paper Title: |
AN MSE APPROACH FOR TRAINING AND CODING STEERED MIXTURES OF EXPERTS |
Authors: |
Michael Tok; Technische Universität Berlin, Germany | | |
| Rolf Jongebloed; Technische Universität Berlin, Germany | | |
| Lieven Lange; Technische Universität Berlin, Germany | | |
| Erik Bochinski; Technische Universität Berlin, Germany | | |
| Thomas Sikora; Technische Universität Berlin, Germany | | |
Abstract: |
Previous research has shown the interesting properties and potential of Steered Mixture-of-Experts (SMoE) for image representation, approximation, and compression based on EM optimization. In this paper we introduce an MSE optimization method based on Gradient Descent for training SMoEs. This allows improved optimization towards PSNR and SSIM and de-coupling of experts and gates. In consequence we can now generate very high quality SMoE models with significantly reduced model complexity compared to previous work and much improved edge representations. Based on this strategy a block-based image coder was developed using Mixture-of-Experts that uses very simple experts with very few model parameters. Experimental evaluations shows that a significant compression gain can be achieved compared to JPEG for low bit rates. |