New RIFE filter - 3x faster AI interpolation possible in SVP!!! (Page 98 of 99)

RickyAstle98 wrote:

dawkinscm wrote:

Thanks for the the heads up

Update: I watched a full 7 minute sequence with zero stutters and is surprisingly smooth, considering IC 6% but 8% is more reliably stutter free.

As of today my settings are SVP: Rife v4.25, IC 8%, Blend Adjacent Frames. MPV: Interpolation on, resample audio. GPU: 590.26, Smooth Motion (Globally) On. Windows 11: Optimizations for Windowed Games.

These SVP settings fixes Rife's double image issues with fast vertical motion in movies like Dr Strange 2. Also GPU usage is greatly reduced. Maybe this is because it doesn't try to interpolate as many frames?.
These MPV settings stops it from dropping frames and helps with any remaining smoothness issues after SVP interpolation. I also use exclusive full screen but for most users I don't think this is "needed".
These Nvidia settings are not the only option but these work as well as any. A mild overclock still works best which is strange considering the GPU usage but maybe the peaks are higher?
The Windows settings are for MPV and other relevant software to work optimally with Windows 11.

I'm sure there's other ways of doing this, but this is the first time I have an explainable reason for each setting instead of just hope. This works for my VR setup so YMMV.

I will try to play with mpv swapchain parameters, LSFG ignores newest drivers flip models, producing smoothest image through DWM compositor, why not to force mpv to choose DWM composition too? Because before 566.14 driver, DWM was default!

Wait, 590.26 FIXED some issues?!

I would be surprised if LFSG ignores filp models since modern Nvidia drivers all have Multiplane Overlay built in specifically to work with it. This was one of the Nvidia features I turned off not knowing that I was probably hurting more than helping.
I wouldn't play with the MPV swapchain. From my testing I found that the default is ideal so that's what my SVP Nvidia settings also use. I forgot to add this to my settings list because I set this up some time ago.
As for transcoding speed, I only look at the end results. Are packets dropped? Is the GPU stuck on 100%? Is SVP stable around 0.99 to 1.01 or is it fluctuating? My current answers are no, no and stable.

RickyAstle98 wrote:

dawkinscm wrote:

I would be surprised if LFSG ignores filp models since modern Nvidia drivers all have Multiplane Overlay built in specifically to work with it. This was one of the Nvidia features I turned off not knowing that I was probably hurting more than helping.
I wouldn't play with the MPV swapchain. From my testing I found that the default is ideal so that's what my SVP Nvidia settings also use. I forgot to add this to my settings list because I set this up some time ago.
As for transcoding speed, I only look at the end results. Are packets dropped? Is the GPU stuck on 100%? Is SVP stable around 0.99 to 1.01 or is it fluctuating? My current answers are no, no and stable.

I think ignores because of this magic things, running LSFG at same target FPS as RIFE - making mpv looks smooth, very smooth, despite not generating frames at all!
Also I think LSFG ignores newest compositors because how quickly my monitor switches and holds refresh rate, currently at stable 581 (yes reverted back for games), during standard mpv playback without any interpolation, VRR fluctuating!

UPD: Running external video capture to get VRR jumps via SpecialK measurement, mpv during 1 minute scene at FIXED 24FPS fluctuates 210 times (no interpolation), and only 30 with LSFG ontop, DWM works flawlessly!

Cool. We can only use what works.  Since I'm using Exclusive Fullscreen it's probably bypassing Flip and using DWM anyway lol.

RickyAstle98 wrote:

dawkinscm wrote:

Cool. We can only use what works.  Since I'm using Exclusive Fullscreen it's probably bypassing Flip and using DWM anyway lol.

Nope, doesnt happen to me, Exclusive Fullscreen behavior the same as before, destroyed framepacing with/without, thats your Win11 feature, my Win10 cant bypass that maybe?

Dunno. I read about it somewhere that flip gets similar performance to exclusive that's why I re-enabled Nvidia MPO, but if you turn on exclusive then it is smart enough to bypass itself or something like that.

RickyAstle98 wrote:

dawkinscm wrote:

Dunno. I read about it somewhere that flip gets similar performance to exclusive that's why I re-enabled Nvidia MPO, but if you turn on exclusive then it is smart enough to bypass itself or something like that.

The MPO doesnt work correctly with Windows 10 system, thats why LSFG only allows DXGI renderer, DWM>Composed Flip instead of FSE>Hardware Composed Flip (your behavior)

The SpecialK somehow solved all judder/jerks/stutter problems, continuously holds refresh rate much agressively, but unstable on seek, I dont want to lose performance/smoothness in games for video players, SpecialK helps, trying to inject SpecialK window management through mpv library!

UPD: MPV Interpolation argument yes and D3D11 sync intervals solved the problems, but unstable enough!

Never heard of Special K but it looks interesting. Some of what it does is kind of what I'm doing but with Windows 11.

BTW what do you do with the Sync intervals, disable it?

Update:I've been testing my new settings with fast action. But I just tested my new settings with slow panning shots and it forced me to make some changes to my original recommendations.

As of today my settings are SVP: Rife v4.25, IC 8%, Blend Adjacent Frames. MPV: Interpolation on, resample audio. GPU: 577 or 566.36. Windows 11 Optimization for Windowed Apps: MPV

Optical flow seems to also help possibly removing the need for the overclock but at the cost of the occasional major stutter so nope.

dawkinscm wrote:

RickyAstle98 wrote:

The MPO doesnt work correctly with Windows 10 system, thats why LSFG only allows DXGI renderer, DWM>Composed Flip instead of FSE>Hardware Composed Flip (your behavior)

The SpecialK somehow solved all judder/jerks/stutter problems, continuously holds refresh rate much agressively, but unstable on seek, I dont want to lose performance/smoothness in games for video players, SpecialK helps, trying to inject SpecialK window management through mpv library!

UPD: MPV Interpolation argument yes and D3D11 sync intervals solved the problems, but unstable enough!

Never heard of Special K but it looks interesting. Some of what it does is kind of what I'm doing but with Windows 11.

BTW what do you do with the Sync intervals, disable it?

Update:I've been testing my new settings with fast action. But I just tested my new settings with slow panning shots and it forced me to make some changes to my original recommendations.

As of today my settings are SVP: Rife v4.25, IC 8%, Blend Adjacent Frames. MPV: Interpolation on, resample audio. GPU: 577 or 566.36. Windows 11 Optimization for Windowed Apps: MPV

Optical flow seems to also help possibly removing the need for the overclock but at the cost of the occasional major stutter so nope.

The sync intervals prevents NVIDIA default driver compositor deliver frames non-directly, monitor VRR in charge, but breaks at seek again!
As I said, this is just VRR framepacing issue through the driver level, older drivers or LSFG ontop prevents monitor spontaneous refreshes, as you can see, earlier, I noticed how much VRR jumps got through standard MPV playback on new stable drivers, which not happens with LSFG ontop or after SpecialK injection, SpecialK makes 72FPS content not only smooth, but fast, not sure how that effect occurs, tested Gemini movie at real 60FPS compared to 24>60 and was surprised how SpecialK deliver frames, but I dont know how to inject SpecialK through MPV swapchain directly!

UPD: Found best solution to change present methods through NVPI program (inspector)! WORKS!!!

dawkinscm wrote:

RickyAstle98 wrote:

The sync intervals prevents NVIDIA default driver compositor deliver frames non-directly, monitor VRR in charge, but breaks at seek again!
As I said, this is just VRR framepacing issue through the driver level, older drivers or LSFG ontop prevents monitor spontaneous refreshes, as you can see, earlier, I noticed how much VRR jumps got through standard MPV playback on new stable drivers, which not happens with LSFG ontop or after SpecialK injection, SpecialK makes 72FPS content not only smooth, but fast, not sure how that effect occurs, tested Gemini movie at real 60FPS compared to 24>60 and was surprised how SpecialK deliver frames, but I dont know how to inject SpecialK through MPV swapchain directly!

UPD: Found best solution to change present methods through NVPI program (inspector)! WORKS!!!

Did some more testing. My Nvidia MPO on Windows 11 works well, especially for fast motion, but I was having issues with slow panning. Turning off MPO is better for slow pans, smoother overall, almost stutter free at 6% and pretty much stutter free at 8%. Since MPO is off I've also turned off the other Windows optimisations since Nvidia MPO is designed to work with them. More testing to do but, Optical Flow is helping smoothness again but without the stutters or at least that is the case so far. I'm basically back to where I was at the start lol.

Looks like only LSFG works well, no matter of drivers, making low framerate content look better!
RIFE + LSFG = better (for me)

As better, because RIFE 24>72 looks good but framepacing issue still occurs (driver issue), LSFG 72 target, voila, buttery smooth! Magic!

dawkinscm wrote:

RickyAstle98 wrote:

Looks like only LSFG works well, no matter of drivers, making low framerate content look better!
RIFE + LSFG = better (for me)

As better, because RIFE 24>72 looks good but framepacing issue still occurs (driver issue), LSFG 72 target, voila, buttery smooth! Magic!

Where do you get it from? Steam purchase?

Yes, Steam purchase, 1.5$ on sale, but you can use LS program w/o Steam!

https://drive.google.com/file/d/1oS9coY … sp=sharing

UPD: Tested on 8 different PC and 3 operation systems, LS behavior always the same, magic works!

dawkinscm wrote:

RickyAstle98 wrote:

Yes, Steam purchase, 1.5$ on sale, but you can use LS program w/o Steam!

https://drive.google.com/file/d/1oS9coY … sp=sharing

UPD: Tested on 8 different PC and 3 operation systems, LS behavior always the same, magic works!

Thanks for the try out My 4080 drops too many frame when I try to run this and Rife v4.25 with 4K 3D unless I use LSFG 2.1 x2 scale. Even at 1440p in the lower quality adaptive mode too many frames get dropped when running LSFG 3.1. Maybe Performance mode would work but there's no point if I'm going to loose the laser projector like quality I have. Interesting software though.

What LS settings are you running? Just drop screenshot, dont use LSFG on 3D content, works differently!

Dont use LSFG when your performance already at peaks, LSFG about 8 times less resource-sensitive, but you cant get 240FPS out-of-box when your system only allows 160 for example!

The rule of thumb: can run RIFE x3? = can run RIFE x2 + LSFG x4 easy!

dawkinscm wrote:

RickyAstle98 wrote:

What LS settings are you running? Just drop screenshot, dont use LSFG on 3D content, works differently!

Dont use LSFG when your performance already at peaks, LSFG about 8 times less resource-sensitive, but you cant get 240FPS out-of-box when your system only allows 160 for example!

The rule of thumb: can run RIFE x3? = can run RIFE x2 + LSFG x4 easy!

Using 3D, 100% GPU spikes but mostly around 90% so

Depends on settings, just drop your settings screenshot, will try to bring usable parameters, LSFG doesnt work better at peaks, cant discard frames just-in-time, unload frames in-time!

dawkinscm wrote:

RickyAstle98 wrote:

Depends on settings, just drop your settings screenshot, will try to bring usable parameters, LSFG doesnt work better at peaks, cant discard frames just-in-time, unload frames in-time!

Thanks for the offer, but I don't have any settings because tried everything except anything that said quality drop like performance mode. 3.1 is a no/no. 2.1 with x2 works. 1.1 I think works worse than 2.1. Flow scale set to 50% and scaling scaling off.

Not only flow scale or generation type can make a difference at high loads, play with different settings, as LSFG professional owner, can say proper settings!

dawkinscm wrote:

RickyAstle98 wrote:

Not only flow scale or generation type can make a difference at high loads, play with different settings, as LSFG professional owner, can say proper settings!

What other settings are there that have can reduce GPU load without affecting quality? I will try those.

Type: 3.1 (better overall) / Fixed x2 / Adaptive refresh
Flow scale: for 4K you can use lowest possible 25% without performance mode
Capture: WGC recommended for Win11 users, try both, WGC provides less latency!
Queue target: ofcourse 2 (cuz we already at peaks)
Sync mode: Vsync
Max frame latency: 15
GSync support: supposed to be off (when you targeting refresh)