MSU Video Codecs Comparison 2021
Part 5: FPGA/Hardware-accelerated/Ultra-fast encoders
Sixteen Annual Video-Codecs Comparison by MSU
Anastasia Antsiferova,
Egor Sklyarov,
Alexander Yakovenko,
Nickolay Safonov,
Alexander Gushin,
Nikita Alutis
Moscow State University (MSU)
Graphics and Media Lab Dubna International
State University Institute for Information
Transmission Problems,
Russian Academy of Science
News
- 11.04.2022 Report release
Navigation
Description
In MSU FPGA/Hardware-accelerated/Ultra-fast Video Codecs Comparison 2021, we analyzed 4 hardware and 3 software codecs. The speed requirement for all platforms was 60 fps. Some of the participants could not reach speed requirement, but we decided to publish all results anyway to show the current landscape. 50 FullHD video sequences were used.
Results
- The places below are given by quality scores
- Encoders with scores closer than 1% share one place
YUV-SSIM, Y-VMAF (v0.6.3)
YUV-PSNR
YUV-SSIM
YUV-SSIM
(neglecting lookahead i/o time)
YUV-SSIM, Y-VMAF (v0.6.3)
(neglecting lookahead i/o time)
YUV-PSNR
Speed/quality trade-off "Ultra-fast 60 fps" all sequences, YUV (4:1:1)-SSIM metric
Speed/quality trade-off "Ultra-fast 60 fps (neglecting lookahead i/o time" all sequences, YUV (4:1:1)-SSIM metric
The winners vary for different objective quality metrics. The participants were rated using BSQ-rate (enhanced BD-rate) scores [1].
[1] A. Zvezdakova, D. Kulikov, S. Zvezdakov, D. Vatolin, "BSQ-rate: a new approach for video-codec performance comparison and drawbacks of current solutions," 2020.
Download
Objective comparison of ultra-fast and hardware-accelerated video encoders
Released on April, 11
Full version for free
BVE 1.0 (FPGA), Fudan (FPGA), NVENC H.265 (GPU), NVENC H.264 (GPU); Tencent V265 (CPU), QAV1 (CPU), x265 (CPU)
60 fps encoding
5400+ interactive charts
Participants
MulticoreWare, Inc. CPU H.265/HEVC 3.5+1-f0c1022b6, Windows
Tencent Ultra-fast (60 fps) H.265/HEVC -
Bytedance Inc. FPGA (60 fps) - -
Fudan University FPGA (60 fps) - -
- Ultra-fast (60 fps) H.265/HEVC -
iQIYI Inc. Ultra-fast (60 fps) AV1 -
Comparison Rules
Hardware-accelerated and ultra-fast codecs testing objectives
The main goal of this report is the presentation of a comparative evaluation of the quality of new and existing codecs using objective measures of assessment. The comparison was done using settings provided by the developers of each codec. Nevertheless, we required all presets to satisfy minimum speed requirement on the particular use case. The main task of the comparison is to analyze different encoders for the task of transcoding video – e.g., compressing video for personal use.
Test Hardware Characteristics for CPU encoders
- CPU: Intel Socket 1151 Core i7 8700K (Coffee Lake) (3.7Ghz, 6C12T, TDP 95W)
- Mainboard: ASRock Z370M Pro4
- RAM: Crucial CT16G4DFD824A 2x16GB (totally 32 GB) DIMM DDR4 2400MHz CL15
- OS: Windows 10 x64, Linux
Test Hardware Characteristics for GPU encoders
- CPU: Intel Socket 1151 Core i7 8700K (Coffee Lake) (3.7Ghz, 6C12T, TDP 95W)
- GPU: NVIDIA TITAN RTX
- Mainboard: ASRock Z370M Pro4
- RAM: Crucial CT16G4DFD824A 2x16GB (totally 32 GB) DIMM DDR4 2400MHz CL15
- OS: Windows 10 x64, Linux
Test Hardware Characteristics for FPGA encoders
- CPU: Intel Socket 1151 Core i7-6700K (Skylake) (4.00GHz, 4C8T, TDP 91 W)
- FPGA: Xilinx Alveo U250 Accelerator
- Mainboard: ASUSTeK Z170-K
- RAM: Crucial CT16G4DFD824A 4x8GB (totally 32 GB) DIMM DDR4 2100MHz CL15
- OS: CentOS 7
See more on Call For Codecs 2021 page
Videos
Videos for testing set were chosen from MSU video collection via a voting among comparison participants, organizers and an independend expert.
Final video set consists of 50 sequences including new videos from Vimeo and media.xiph.org derf's collection.
Descriptions of all test videos are presented in a separate PDF provided with the report.
Codec Analysis and Tuning for Codec Developers and Codec Users
Computer Graphics and Multimedia Laboratory of Moscow State University:
- 17+ years working in the area of video codec analysis and tuning using objective quality metrics and subjective comparisons.
- 30+ reports of video codec comparisons and analysis (H.265, H.264, AV1, VP9, MPEG-4, MPEG-2, decoders' error recovery).
- Methods and algorithms for codec comparison and analysis development, separate codec's features and codec's options analysis.
Strong and Weak Points of Your Codec
- Deep encoder parts analysis (ME, RC on GOP, mode decision, etc).
- Weak and strong points for your encoder and complete information about encoding quality on different content types.
- Encoding Quality improvement by the pre and post filtering (including technologies licensing).
Independent Codec Estimation Comparing to Other Codecs for Different Use-cases
- Comparative analysis of your encoder and other encoders.
- We have direct contact with many codec developers.
- You will know place of your encoder between other newest well-known encoders (compare encoding quality, speed, bitrate handling, etc.).
Encoder Features Implementation Optimality Analysis
We perform encoder features effectiveness (speed/quality trade-off) analysis that could lead up to 30% increase in the speed/quality characteristics of your codec. We can help you to tune your codec and find best encoding parameters.Thanks
Special thanks to the following contributors of our previous comparisons
Contact Information
Subscribe to report updates
Other Materials
Video resources:
Projects on 3D and stereo video processing and analysis
- MSU S3D-video analysis reports
- MSU 3D Devices Testing
- 3D Displays Video Generation
- 3D Displays Video Capturing
- Stereo Video Depth Map Generation
- SAVAM Saliensy-Aware Video Compression & Dataset
- Video Matting Benchmark
- Video Inpainting Benchmark
MSU Video Quality Measurement tools
Programs with different objective and subjective video quality metrics implementation
- MSU Video Quality Measurement Tool - objective metrics for codecs and filters comparison
- MSU Human Perceptual Quality Metric - several metrics for exact visual tests
Objective and subjective quality evaluation
tests for video and image codecs
- MSU Video Codecs Comparison 2025
- MSU Video Codecs Comparison 2023-2024
- MSU Video Codecs Comparison 2022
- MSU Video Codecs Comparison 2021
- MSU Video Codecs Comparison 2020
- MSU Cloud Benchmark 2020
- Cloud Encoding Services Comparison 2019
- HEVC/AV1 Codec Comparison 2019
- HEVC/AV1 Codec Comparison 2018
- HEVC/AV1 Codec Comparison 2017
- HEVC Codec Comparison 2016
- HEVC Codec Comparison 2015
- 9-th MPEG4-AVC/H.264 Comparison
- 8-th MPEG4-AVC/H.264 Comparison
- 7-th MPEG4-AVC/H.264 Comparison
- 6-th MPEG4-AVC/H.264 Comparison
Here are available VirtualDub and AviSynth filters. For a given type of digital video filtration we typically develop a family of different algorithms and implementations. Generally there are also versions optimized for PC and hardware implementations (ASIC/FPGA/DSP). These optimized versions can be licensed to companies. Please contact us for details via video(at)graphics.cs.msu_ru.
- MSU Cartoon Restore
- MSU Noise Estimation
- MSU Frame Rate Conversion
- MSU Image Restoration
- MSU Denoising
- MSU Old Cinema
- MSU Deblocking
- MSU Smart Brightness and Contrast
- MSU Smart Sharpen
- MSU Noise generation
- MSU Noise estimation
- MSU Motion Estimation Information
- MSU Subtitles removal
- MSU Logo removal
- MSU Deflicker
- MSU Field Shift Fixer AviSynth plug-in
- MSU StegoVideo
- MSU Cartoonizer
- MSU SmartDeblocking
- MSU Color Enhancement
- MSU Old Color Restoration
- MSU TV Commercial Detector
- MSU filters FAQ
- MSU filters statistics
We are working with Intel, Samsung, RealNetworks and other companies on adapting our filters other video processing algorithms for specific video streams, applications and hardware like TV-sets, graphics cards, etc. Some of such projects are non-exclusive. Also we have internal researches. Please let us know via video(at)graphics.cs.msu_ru if you are interested in acquiring a license for such filters or making a custom R&D project on video processing, compression, computer vision.
- 3D Displays Video Generation
- 3D Displays Video Capturing
- Stereo Video Depth Map Generation
- Automatic Objects Segmentation
- Semiautomatic Objects Segmentation
- New Frame Rate Conversion
- New Deinterlacer
- MSU-Samsung Deinterlacing Project
- Digital TV Signal Enhancement
- Old Film Recovery
- Tuner TV Restore
- Panorama
- Video2Photo
- SuperResolution
- SuperPrecision
- MSU-Samsung image and video resampling
- MSU-Samsung Frame Rate Conversion
- Motion Phase filter
- Deshaker (video stabilization)
- Film Grain/Degrain filter
- Deblurring filter
- Video Content Search
Different research and development
projects on video codecs
- MSU Lossless Video Codec (Top!)
- MSU Screen Capture Lossless Codec (Top!)
- MSU MPEG-2 Video Codec
- x264 Codec Improvement
Other information
- Crazy gallery (filters screams :)
- License for commercial usage of MSU VideoGroup Public Software (please be careful: some soft like metrics has another license!)
Server size: 8069 files, 1215Mb (Server statistics)
Project updated by
Server Team and
MSU Video Group
Project sponsored by YUVsoft Corp.
Project supported by MSU Graphics & Media Lab