Chainik wrote:
Blackfyre wrote:

Any progress at all with Dolby Vision ...

MPC Video Renderer + Avisynth Filter can now play DoVi

Hoping SVP + Vapoursynth 64 also get it sorted in the next couple of months, when combined with RIFE.

Is there a chance? Or should I switch to MPC? Haven't used MPC in years.

Is it still MPC + Madvr (for upscaling) + RIFE now get the best quality?

Btw Dolby Vision works fine with these configurations for me, but the problem is when RIFE is enabled, I start getting bright flickers happening and blacks becoming gray:

removed as I am changing stuff

Any progress at all with Dolby Vision and RIFE working correctly? Are there any updates to look forward to or being tested in beta?

EDIT:

Can @Chainik please update MPV to v0.36.0 from July, the installer says it is currently using v0.35.1 from January.

53

(4 replies, posted in Using SVP)

It takes 3 to 10 minutes for every aspect ratio change, depending on hardware. So just wait for it.

ONLY the first time of each aspect ratio.

So, what I usually do after a PC format for example is go to a movie or tv show folder, and just run randomly, one at a time, and leave them in the background while I use the internet.

PS: I wish there was ONE video that has all the aspect ratios, that one can use + combined with cut black bars from SVP together to just let all of them build. Is this something that someone can make? Run each aspect ratio for 1 minute then change. A 720p video, a 1080p video, and a 4K video, of just a white/black no audio aspect ratio changers.

Chainik I have a question, are the engine cache models system dependent? Or can they be transferable?

For example, once I have completed the majority of resolutions, or all the ones I use. Can I basically compress them into one file, back them up, place them back after I format? Or even use them in another system completely?

Thank you @UHD for all that detailed analysis and what can be done for the future.

Loved reading it.

dawkinscm wrote:

Rife is flawlessly smooth with minimal artefacts.

It has different artifacts, although minimal the vast majority of the time (compared to prior methods). However, when they are noticeable, like in the beginning of the movie AIR that came out recently (scenes with a lot of noise especially), they are very heavy and noticable. Or the HBO (static) background at the start of GoT/HoTD/etc

So I think the Video Deblurring and Video Frame Interpolation championed by @UHD should be in its own thread.

Once there is a working model, there should definitely be a new thread for it. But I feel as though that is a while away.

Wishing @UHD luck with his proposal.

56

(7 replies, posted in Using SVP)

That sounds great for those using iOS

Xenocyde wrote:
UHD wrote:

If anyone is interested in much, much better quality than RIFE interpolation I will write about it soon, here on this forum. Please give me another week, maybe two weeks, until I update my repository on GitHub.

2 weeks are up, UHD! Time to spill the beans, don't keep us boiling here roll

He will post when he is ready. No rush, take your time.

You can't fix the wait times.

There was news before that future versions of RIFE might seek faster. So, we'll see with future updates.

As it is the best option by far, there's no choice but to wait. I cannot go back to using anything other than RIFE now after experiencing it. In fact I don't care about seek wait times, the most important thing for me is better artifact masking, if RIFE can improve its artifact masking, then I am a happy man.

zxcvbnm821 wrote:

Hello everyone, would it be better for RIFE to enable NVIDIA Optical Flow?

Doesn't matter, because it does not use nVidia Optical Flow.

NVOF can be used outside of RIFE, but it's not as good as RIFE. I was using it before switching to RIFE after I got my RTX 3090.

Sopheus wrote:

Not sure how everyone is able to play on x3 in 4K

Here's your issue.

Sopheus wrote:

4K display 60hz 8 bpc

You're trying to play over the display refresh rate, I haven't done that myself as I only have an RTX 3090, but I have an LG C2 OLED, so it is running at 120Hz.

If your 4K Display is only 60Hz, I recommend you switch to 50Hz for 24 and 25 FPS videos. Keep RIFE at Movie 2X and test my settings for your MPV Configuration:

ontop
fullscreen=yes
d3d11-exclusive-fs=yes

volume=100
volume-max=100

vo=gpu-next
gpu-api=d3d11
hwdec=d3d11va
gpu-context=d3d11
drm-vrr-enabled=no
d3d11-sync-interval=1

dither=error-diffusion
error-diffusion=burkes
dither-depth=10
video-sync=audio
spirv-compiler=auto

dolbyvision=yes
tone-mapping=auto
hdr-compute-peak=yes
target-colorspace-hint
tone-mapping-mode=auto
tone-mapping-param=auto

scale=ewa_lanczos
cscale=ewa_lanczos
dscale=ewa_lanczos
tscale=ewa_lanczos
Fortune424 wrote:

I think I can confirm. It really is painfully obvious when you do a side by side comparison.

I didn't even do side-by-side, the moment I upgraded and played the first video, I was like what am I looking at it lol Good to see it confirmed in pictures though above.

I don't think it's a worry anyway, since SVP Devs likely knew the issue and that's why SVP still runs with v1

Like I said before, quality and smoothness of RIFE is pretty much unmatched right now. Personally, the only improvements I want to see from hereon is for artifact masking.

Right Click any media file type (for example .mkv or .mp4) that you want to watch with MPV, then click on "Properties".

It should look like this image below, then click "Change". Scroll down the list and click "Choose an app on your PC" at the bottom of the list. Then navigate to the directory "C:\Program Files (x86)\SVP 4\mpv64" and choose the "mpv" application (it will be the purple icon one). Then choose it as the DEFAULT app for that file type.

When you encounter a new media file type (for example say you done it for .mkv above, and then you go to a .mp4 file type), all you have to do is click "Change" under Properties, and mpv will always be there from now on.

You only need to do this ONCE for each file type you choose. After that it should save for the future.

https://i.imgur.com/5jr9y8G.png

For the ones above, after testing yesterday, the quality with RIFE that comes with SVP is better than the v2 I updated to via the links above.

Current RIFE with SVP shows less artifacts for example on intros when names are showing up, and smoother overall.

rife_V2 is creating artifacts and the quality seems to drop as well on 4K content looking like 1080p, at least with my MPV settings.

Forgot to back up my vsmlrt.py and had to remove RIFE and add it back. Now picture quality and smoothness is back to being better.

By the way @Chainik, if it's possible to add a fourth option under maintenance called "Check File Integrity". So, it checks all the SVP files and replaces them with the default ones from SVP. Overriding any changes we make to RIFE or MPV folder, etc.

UHD wrote:

If anyone is interested in much, much better quality than RIFE interpolation I will write about it soon, here on this forum. Please give me another week, maybe two weeks, until I update my repository on GitHub.

This is very exciting by the way. I don't know how anything can be better than RIFE, basically RIFE with better Artifact Masking for me is the ultimate goal (just artifact masking getting better and better). Because smoothness wise, RIFE is already insane, so I can't imagine better. Maybe efficiency? Because RIFE is very demanding.

Couple of questions if you don't mind me asking:

1. Will it be as efficient or more efficient than RIFE interpolation? Or will it be more demanding?

2. Is this live interpolation? Or will it have to be via transcode. I only use the live options on 4K content.

As an RTX 3090 + Ryzen 5800X owner, I am really looking forward to it. Thank you.

Great write-up @UHD thank you for the details. Appreciate it and I will look at the links in detail later today.

I noticed with the current version with MPV there are still some artifact issues that I hope can be handled better in the future.

For example, within the film Tenet, around the 35 minute mark the texture on the clothes has bad artifacting.

Tried to capture it here, link will be up for 24 Hours only. Source is 4K Bluray Remux of the film:

https://streamable.com/q9vj6q

Also, after the 11th minute mark there are artifacts on the antennas at the back of the boat as it travels on water:

https://streamable.com/7kdd13

Not sure if versions above have fixed such issues, but it would be nice to have improved artifact masking.

Really appreciate RIFE, it is by far the best motion interpolation method I have seen thus far.

---

EDIT:

I backed up, then replaced the ones you linked with the ones inside (C:\Program Files (x86)\SVP 4\rife\models\rife), but it did not work. I will wait for the update via the app.

66

(11 replies, posted in Using SVP)

Cleaned further (removed redundant settings for gpu-next), changed tone-mapping options to auto for better accuracy, removed all ewa_lanczossharp and changed them with ewa_lanczos as gpu-next makes the former useless and waste more energy for no reason.

Below configuration now runs better (performance improved compared to previous configurations):

ontop
volume=100
volume-max=100
fullscreen=yes

vo=gpu-next
gpu-api=d3d11
hwdec=nvdec-copy
gpu-context=d3d11
drm-vrr-enabled=no

dither=no
dither-depth=no
video-sync=audio
spirv-compiler=auto

dolbyvision=yes
tone-mapping=auto
hdr-compute-peak=yes
target-colorspace-hint
tone-mapping-mode=auto
tone-mapping-param=auto

scale=ewa_lanczos
cscale=ewa_lanczos
dscale=ewa_lanczos
tscale=ewa_lanczos

osd-level=1
osd-bar-w=25
osd-color=0.5
osd-bar-align-x=0
osd-bar-align-y=-1

sub-pos=100
sub-color=0.5
sub-margin-y=3
sub-font-size=37
sub-align-x=center
sub-align-y=bottom
sub-ass-shaper=complex
sub-scale-by-window=yes

glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\KrigBilateral.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\SSimDownscaler.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\FSRCNNX_x2_8-0-4-1.glsl"

Do the versions from the study correspond to the ones we use? I assume not.

The scientific study is up to version 12:

https://arxiv.org/abs/2011.06294

68

(11 replies, posted in Using SVP)

dawkinscm wrote:

FBO doesn't work with gpu-next according to the gpu-next errata. It looks like you are using Windows and if so then there's no need for Vulkan and no need to set context either.

SVP says you are supposed to use a copy-back decoder but I've tried a non copy-back decoder and I'm not sure it's necessary now. But I leave it in because it is not affecting performance. Hopefully one of the devs like Chainik can clarify.

Thanks, I didn't have any stability issues or performance issues. But I switched to DX11 and cleaned up my configuration. No difference in performance or stability. Still running exactly the same. Dolby Vision washed out colours are still present (only with SVP enabled), Dolby Vision works fine without SVP.

Any other recommendations to this:

ontop
volume=100
volume-max=100
fullscreen=yes

vo=gpu-next
gpu-api=d3d11
profile=gpu-hq
dolbyvision=yes
hwdec=nvdec-copy
gpu-context=d3d11
drm-vrr-enabled=no

video-sync=audio
dither-depth=auto
spirv-compiler=auto
linear-downscaling=no

tone-mapping=mobius
hdr-compute-peak=yes
tone-mapping-mode=luma
tone-mapping-max-boost=4
tone-mapping-param=mobius

sigmoid-upscaling=yes
scale=ewa_lanczossharp
cscale=ewa_lanczossharp
dscale=ewa_lanczossharp

osd-level=1
osd-bar-w=25
osd-color=0.5
osd-bar-align-x=0
osd-bar-align-y=-1

sub-pos=100
sub-color=0.5
sub-margin-y=3
sub-font-size=37
sub-align-x=center
sub-align-y=bottom
sub-ass-shaper=complex
sub-scale-by-window=yes

glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\KrigBilateral.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\SSimDownscaler.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\FSRCNNX_x2_8-0-4-1.glsl"

69

(11 replies, posted in Using SVP)

Chainik wrote:

Dolby Vision isn't supposed to work with Vapoursynth scripts at all.
https://github.com/mpv-player/mpv/issues/10438
SVP's provided mpv is patched by me, but I've no idea why it blinks sometimes and nobody from mpv's team seems to work on this.

Oh fair enough.

I had it for working for like 1 whole day with SVP + Optical Flow, I forgot which configuration I used. But the colours were not washed out, and everything looked fine, except for the flashing (dolby vision flashing was always there).

I think as mentioned above in the github, the flashing probably happens because in the middle-generated frame the brightness/colour data is lost compared to the real frames and it causes a flash.

As for flashing outside Dolby Vision, I fixed all of that by disabling VRR from the LG Game Optimiser Menu (turn off GSync and Freesync), as they both cause flashing in low brightness (dark) scenarios. This has been a problem for years with OLED TV's and VRR.

70

(11 replies, posted in Using SVP)

dlr5668 wrote:

New dev rife build will also reduce lag on rewind to zero

Nice, can't wait for an update. It feels like I'm watching content in a completely new way now with RIFE.

Doubt we'll see it, but if performance improves to allow me to push 3x the framerate with my RTX 3090 that would be amazing.

Still don't know why Dolby Vision flickers with SVP on, and with RIFE the colours also wash out and blacks become dark grey, here is my current configuration:

ontop
fullscreen=yes

dolbyvision=yes

vo=gpu-next
profile=gpu-hq
fbo-format=rgba16hf
gpu-api=vulkan
gpu-context=winvk

hwdec=nvdec

linear-downscaling=no

spirv-compiler=auto
video-sync=audio
vulkan-swap-mode=fifo
video-sync-max-video-change=5
drm-vrr-enabled=no

tone-mapping=mobius
hdr-compute-peak=yes
tone-mapping-mode=luma
tone-mapping-param=mobius
tone-mapping-max-boost=1.0

dither-depth=auto

scale=ewa_lanczossharp
cscale=ewa_lanczossharp
dscale=ewa_lanczossharp
sigmoid-upscaling=yes

osd-level=1
osd-bar-align-x=0
osd-bar-align-y=-1
osd-bar-w=25
osd-color=0.5

sub-ass-shaper=complex
sub-font-size=37
sub-scale-by-window=yes
sub-pos=100
sub-align-x=center
sub-align-y=bottom
sub-margin-y=3
sub-color=0.5

volume=100
volume-max=100

glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\KrigBilateral.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\SSimDownscaler.glsl"
glsl-shader="C:\Users\musta\AppData\Roaming\mpv\Shaders\FSRCNNX_x2_8-0-4-1.glsl"

71

(11 replies, posted in Using SVP)

dlr5668 wrote:

Rife kinda killed it (for video interpolation)

I haven't tried it in over a month. If the issue is fixed where it takes so long to open a 4K file, then I would use it without hesitation.

But the loading issues always put me off.

EDIT:

OKAY WOW THE DIFFERENCE IS MASSIVE!

Even at double the FPS (48FPS) it looks better than anything else at 120FPS.

It is worth the loading time and seek loading time when forwarding and moving back. Artifacts are minimal too. And now I wish my RTX 3090 could push 3x or 4x the framerate haha!

Hi Devs,

I already eliminated all other factors outside of SVP, this issue only happens when SVP is on, and when I exit, the problem goes away. Also, the bright flashing / flickering only happens with Dolby Vision + SVP

HDR 10 works fine, SDR works fine. They are lower bitrate and produce worse colours than Dolby Vision.

I tried to find the best example of this for easy testing and troubleshooting:

The.Mandalorian.S03E04.DV.2160p.WEB.h265-MAVIS (https://rarbg.to/torrent/2k1y9us)

1 minute between 16:25 to 17:25

Testing on LG C2 OLED as a PC monitor.

Also, before anyone asks, I do have a Disney+ Subscription as well as many other subscriptions, and I pay $100+ per month for them.

I just prefer to watch on PC, using MPV + Shaders + SVP

73

(11 replies, posted in Using SVP)

Hi Devs,

This year it seems nVidia pushed 5.x.x versions of optical flow and looking at the release notes I think there might be some new values to play around with? But they aren't available in SVP yet.

Right now, the only values we can change are:

nvof
nvof_grid
nvof_quality

I already check and motion vector grid seems to work with 3 now as well, instead of 4 before being the limit.

Not sure if more options have been added to experiment with and add? And if there are other value updates too.

I am more than happy to beta test with content if there's extra stuff.

74

(9 replies, posted in Using SVP)

I have recently upgraded to an LG C2 42" and using it as a PC Monitor. Had to figure out how to get Dolby Vision to work with MPV, as well as improving tone-mapping, etc.

Old Information here removed - Check my comments below for updated configs:

RTX 3090 when I change the engine to NVIDIA TensorRT and open a video, it opens a command prompt and it keeps loading... Do I just have to wait? Or? I thought it would be faster than Vulkan which plays instantly but can only do 1080p for me, and was hoping to try nVidia TensorRT.

What am I doing wrong? So is it just that I have to wait and let it do its thing? How long do I wait for it?