A Spectrally Adaptive Noise Filling Tool for
Perceptual Transform Coding of Still Images

Christian R. Helmrich, Sebastian Bosse, Paul Keydel, Heiko Schwarz,
Detlev Marpe, Fellow, IEEE, and Thomas Wiegand, Fellow, IEEE

The above paper has been presented and published at the IEEE International Conference on Consumer Electronics (ICCE) in Berlin
in September 2018.  This web page contains supplementary information on the publication, particularly visual demonstrations.

  1. Corrections to the ICCE submitted version of the paper as of August 2018

  2. Subjective demonstrations of the SANFT in a HEVC-like still-image codec

  1. Corrections to the International Conference on Consumer Electronics submitted version as of August 2018

    There are no known issues. The submitted version of the paper is available here: link to document ICCE manuscript

    For the published version, the following sentence has been added at the end of Section IV.B: “As a result, excessive noise may be generated for some images like screen content, which can lead to visible quality degradation.”


  2. Subjective demonstrations of the Spectrally Adaptive Noise Filling Tool in a HEVC-like still-image codec

    The following illustrations serve as a demonstration of the subjective effect of using SANFT in a transform-based still image codec like HEVC. The underlying codec chosen for this demonstration is HEVC [1] with an additional quad-tree/binary-tree (QTBT) tool and extended maximum transform unit size of 64×64 luminance pels [2].  Note that the coding tree unit size remains 64×64 pels, as specified in the HEVC standard [1].

    The presented images were transcoded, with visual transparency, to high-bit-rate JPEG in order to limit the download durations for the viewers.

    BQTerrace_original - Click to view full-sized image.
    BQTerrace, uncoded input (HD, 1920×1080, lossless size: 5480 KB)

    BQTerrace_qp30_qtbt - Click to view full-sized image.
    BQTerrace, HEVC+QTBT without SANFT, QP 30 (HD, 1920×1080, coded size: 135 KB)

    BQTerrace_qp30_qtbt_SANFT - Click to view full-sized image.
    BQTerrace, HEVC+QTBT with SANFT 1.1, QP 30 (HD, 1920×1080, coded size: 137 KB)

    HomelessSleeping_original - Click to view full-sized image.
    HomelessSleeping, uncoded input (UHD, 2560×1600, lossless size: 9770 KB)

    HomelessSleeping_qp30_qtbt - Click to view full-sized image.
    HomelessSleeping, HEVC+QTBT without SANFT, QP 30 (UHD, 2560×1600, coded size: 30 KB)

    HomelessSleeping_qp30_qtbt_SANFT - Click to view full-sized image.
    HomelessSleeping, HEVC+QTBT with SANFT 1.1, QP 30 (UHD, 2560×1600, coded size: 31 KB)

    ParkScene_original - Click to view full-sized image.
    ParkScene, uncoded input (HD, 1920×1080, lossless size: 5415 KB)

    ParkScene_qp30_qtbt - Click to view full-sized image.
    ParkScene, HEVC+QTBT without SANFT, QP 30 (HD, 1920×1080, coded size: 91 KB)

    ParkScene_qp30_qtbt_SANFT - Click to view full-sized image.
    ParkScene, HEVC+QTBT with SANFT 1.1, QP 30 (HD, 1920×1080, coded size: 93 KB)

Please note that the layout or content of this web page may change. If it does, the date in the following line will be updated.

Christian R. Helmrich, August 31, 2018


References

[1]  ITU-T, Recommendation H.265 and ISO/IEC, Int. Standard 23008-2, “High efficiency video coding,” Geneva, Switzerland, Feb. 2018. Online:
       link to external web page http://www.itu.int/rec/T-REC-H.265

[2]  J. An, Y.-W. Chen, K. Zhang, H. Huang, Y.-W. Huang, and S. Lei, “Block partitioning structure for next generation video coding,” ISO/MPEG
       document M37524 and ITU-T SG16 document COM16-C966, Oct. 2015.