1 (edited by tp 29-05-2018 17:30:46)

Topic: Which transcoding settings to use for best results (with my hardware)

I really have no clue what is best, even after doing some reading up.

OS: Windows 10
GPU: NVIDIA GeForce GTX 1080
CPU: Intel Core i5-8600k 3.60GHz
RAM: 16gb

So I don't know what encoder to use, AVC or HEVC, Software, NVENC or QuickSync? Also, do I want to go for MAX bitrate or is there a happy medium? Hope someone can help, as trial and error and trying to distinguish minor results between different settings is really time consuming and difficult.

Also, would love to know the different between "performance" and "quality" in the playback settings. Does moving slider towards "higher performance" mean the video will be less smooth than if I move the slider towards "higher quality"? The terms just seem interchangeable to me.

Re: Which transcoding settings to use for best results (with my hardware)

Would also love to know this! Have similar setup as well

3 (edited by Salatsauce45 20-07-2018 18:40:00)

Re: Which transcoding settings to use for best results (with my hardware)

I am a bit late but I hope I can clear some things up.

Encoder:
Chooses what part of your Hardware transcodes the video, whereas software stands for CPU only and hardware is either your graphics card or the integrated graphics of your CPU (Quicksync for Intel processors). The two latter are generally much faster as they are built for heavily parallelized workloads, using simple mathematical algorithms to transcode a video very fast at the cost of image quality or higher bitrate, usually both. A CPU can use advanced mathematical algorithms, which dramatically increases the time spend for transcoding, depending on what settings you use (see below). However, it has by far the best image quality at a given bitrate or a far lower bitrate at the same quality.

Encoding options:
H264/avc: Older codec, faster but worse quality than
H265/HEVC: As the name says, the high efficiency video codec saves bitrate at the same image quality, but increases transcoding time, especially for the CPU.

Both software and hardware encoding can make use of both codecs. Generally speaking, if you want the lowest bitrate possible, use software h265, if you dont care about file size but want good image quality, choose hardware h265. Hardware H265 is available on all modern graphics cards starting from AMDs r9 300 series and NVIDIA GTX 900 series or newer aswell as 6th generation or newer Intel processors with iGPU (Quicksync).

For CPU encoding: If you go to the advanced encoder tab you can add codec options, eg. presets to control the speed and quality. Here is a list of x265 presets, I do not recommend choosing any faster preset than veryfast as it decreases the blocksize form 64x64 to 32x32, at this point you could just use hardware encoding, there wouldn't be that much of a difference except transcoding speed ofc. Example attached.
Worth to note is that the CRF slider in the basic tab determines a constant image quality displayed in a logarithmic number (20 by default), therefore the lower the number = the better the quality. The bitrate however stays variable and can spike up really fast without any improvement in image quality if you use an overkill number.

Playback settings:
Higher performance uses a faster preset, which speeds up transcoding time at the cost of image quality. Higher quality, as the name tells you, increases the quality but requires better hardware, mostly better cpu.

Post's attachments

transcoding options.png, 30.95 kb, 501 x 527
transcoding options.png 30.95 kb, 427 downloads since 2018-07-20 

Re: Which transcoding settings to use for best results (with my hardware)

I know this is an old thread, but I found it very useful! I'd just like to add for any future forum users out there that any transcoding in progress must be restarted after changing the settings. There is no 'apply' button and this wasn't obvious to me (I was wondering why the transcoding was taking so long).

If this is read by any developers, I'd suggest having a prompt offering to restart any transcodes in progress with the new settings or something along those lines.