Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fields

Overview of the Thera method for aliasing-free super-resolution

Thera is the first arbitrary-scale super-resolution method with a built-in physical observation model.

Show me some results!

First row: Comparison between input image and our super-resolved result.
Second row: Comparison between a SOTA competitor (MSIT) and ours.

How it works

A hypernetwork estimates parameters $\{\mathbf{b}_1, \mathbf{W}_2\}^{(i,j)}$ of pixel-wise, local neural heat fields. The phase shifts $\mathbf{b}_1$ operate on globally learned components, before thermal activations scale each component depending on their frequency and the desired scaling factor. The components are then linearly combined using coefficients $\mathbf{W}_2$, resulting in an appropriately-blurred, continuous local neural field. This field is then rasterized at the appropriate sampling rate (resolution) to yield a part of the final output image (red square). Unlike previous methods, correct anti-aliasing is guaranteed by design!

Thera method

Quantitative comparison

Due to its principled observation model, our method achieves state-of-the-art performance on a variety of super-resolution benchmarks.

Thera results scheme

Citation

If you found our work helpful, consider citing our paper 😊:

Citation coming soon.