UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Sequence-Level Reference Frames In Video Coding

Jubran, M; Abbas, A; Andreopoulos, Y; (2021) Sequence-Level Reference Frames In Video Coding. IEEE Transactions on Circuits and Systems for Video Technology 10.1109/TCSVT.2021.3070423. (In press). Green open access

[thumbnail of 09393393.pdf]
09393393.pdf - Accepted Version

Download (34MB) | Preview


The proliferation of low-cost DRAM chipsets now begins to allow for the consideration of substantially-increased decoded picture buffers in advanced video coding standards such as HEVC, VVC, and Google VP9. At the same time, the increasing demand for rapid scene changes and multiple scene repetitions in entertainment or broadcast content indicates that extending the frame referencing interval to tens of minutes or even the entire video sequence may offer coding gains, as long as one is able to identify frame similarity in a computationally- and memory-efficient manner. Motivated by these observations, we propose a “stitching” method that defines a reference buffer and a reference frame selection algorithm. Our proposal extends the referencing interval of inter-frame video coding to the entire length of video sequences. Our reference frame selection algorithm uses well-established feature descriptor methods that describe frame structural elements in a compact and semantically-rich manner. We propose to combine such compact descriptors with a similarity scoring mechanism in order to select the frames to be “stitched” to reference picture buffers of advanced inter-frame encoders like HEVC, VVC, and VP9 without breaking standard compliance. Our evaluation on synthetic and real-world video sequences with the HEVC and VVC reference encoders shows that our method offers significant rate gains, with complexity and memory requirements that remain manageable for practical encoders and decoders.

Type: Article
Title: Sequence-Level Reference Frames In Video Coding
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TCSVT.2021.3070423
Publisher version: https://doi.org/10.1109/TCSVT.2021.3070423
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Encoding, Standards, Video sequences, Semantics, Proposals, High efficiency video coding, Software
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10126903
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item