Jubran, M;
Abbas, A;
Andreopoulos, Y;
(2021)
Sequence-Level Reference Frames In Video Coding.
IEEE Transactions on Circuits and Systems for Video Technology
10.1109/TCSVT.2021.3070423.
(In press).
Preview |
Text
09393393.pdf - Accepted Version Download (34MB) | Preview |
Abstract
The proliferation of low-cost DRAM chipsets now begins to allow for the consideration of substantially-increased decoded picture buffers in advanced video coding standards such as HEVC, VVC, and Google VP9. At the same time, the increasing demand for rapid scene changes and multiple scene repetitions in entertainment or broadcast content indicates that extending the frame referencing interval to tens of minutes or even the entire video sequence may offer coding gains, as long as one is able to identify frame similarity in a computationally- and memory-efficient manner. Motivated by these observations, we propose a “stitching” method that defines a reference buffer and a reference frame selection algorithm. Our proposal extends the referencing interval of inter-frame video coding to the entire length of video sequences. Our reference frame selection algorithm uses well-established feature descriptor methods that describe frame structural elements in a compact and semantically-rich manner. We propose to combine such compact descriptors with a similarity scoring mechanism in order to select the frames to be “stitched” to reference picture buffers of advanced inter-frame encoders like HEVC, VVC, and VP9 without breaking standard compliance. Our evaluation on synthetic and real-world video sequences with the HEVC and VVC reference encoders shows that our method offers significant rate gains, with complexity and memory requirements that remain manageable for practical encoders and decoders.
Type: | Article |
---|---|
Title: | Sequence-Level Reference Frames In Video Coding |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1109/TCSVT.2021.3070423 |
Publisher version: | https://doi.org/10.1109/TCSVT.2021.3070423 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Encoding, Standards, Video sequences, Semantics, Proposals, High efficiency video coding, Software |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
URI: | https://discovery.ucl.ac.uk/id/eprint/10126903 |
Archive Staff Only
View Item |