1,351 (edited by dawkinscm 26-03-2024 05:23:57)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

abraxas wrote:

4.16 lite is really good, my first tests show the same quality with action movies as 4.15v2 - but 50% better performance. I could go up from x2 (48fps) to x2,5 (60fps) on a 4070 (about 90% GPU) for (nearly) 4K movies.

Rife v4.15 lite has been released and I think it will become the new SVP standard. v4.15 lite handles fast motion artefacts much better than 4.16 lite and is very close to v4.15 but with much better performance smile

Quality: Rife v4.15 > v4.15 lite > v4.16 lite
GPU usage: Rife v4.15 > Rife 4.15 lite = Rife 4.16 lite

1,352

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

i'm seing artifacts in 4.15 lite that i don't see in 4.15

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

oriento wrote:

i'm seing artifacts in 4.15 lite that i don't see in 4.15

That's why I said:
Quality: Rife v4.15 > v4.15 lite > v4.16 lite.

1,354 (edited by dawkinscm 27-03-2024 12:06:27)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Two bits of news. A while ago I said that increasing the frame rate can help with certain fast movement artefacts. Well initial testing suggests that since v4.15 lite is actually "lite",  I'm now able to run SVP at 72fps and it is helping with certain specific types of fast movement artefacts. It's dropping exactly 12 frames a second which makes sense but the helpful effect is not being lost. I still need to do more testing but this looks promising.

Also, Tensorrt v10.0.0 is available. I couldn't believe how bad the benchmarks look but the notes confirm that this is definitely one to avoid.

1,355

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

You do not miss that dropped framea with 60p then? No judder visible like this?

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Olombo wrote:

You do not miss that dropped framea with 60p then? No judder visible like this?

Nope. But YMMV.

1,357 (edited by RickyAstle98 27-03-2024 20:24:58)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:

Two bits of news. A while ago I said that increasing the frame rate can help with certain fast movement artefacts. Well initial testing suggests that since v4.15 lite is actually "lite",  I'm now able to run SVP at 72fps and it is helping with certain specific types of fast movement artefacts. It's dropping exactly 12 frames a second which makes sense but the helpful effect is not being lost. I still need to do more testing but this looks promising.

Also, Tensorrt v10.0.0 is available. I couldn't believe how bad the benchmarks look but the notes confirm that this is definitely one to avoid.

With TRT 10.0 my RTX 4070 struggles to 24>96 hd source (4.16 lite realtime), but easy 24>120 with TRT 9.2 hehe!
Maybe you know solution, why any models after 4.10 not smooth enough? But difference between 4.12 and 4.4 a whole pit, but SMOOTHNESS drop?
Maybe its frame pacing problem, just listen, 4.4v2 24>72 looks very smooth, but has a lot artefacts (no dropped frames), starting 4.10 everything looks like every 3th frame are mismatched (still no dropped frames)!

1,358 (edited by aloola 27-03-2024 20:46:44)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

has anyone tried the option builder_optimization_level=5?
https://github.com/AmusementClub/vs-mlr … g/v14.test

builder_optimization_level – The builder optimization level which TensorRT should build the engine at. Setting a higher optimization level allows TensorRT to spend longer engine building time searching for more optimization options. The resulting engine may have better performance compared to an engine built with a lower optimization level. The default optimization level is 3. Valid values include integers from 0 to the maximum optimization level, which is currently 5. Setting it to be greater than the maximum level results in identical behavior to the maximum level.

someone here said lvl 5 has better performance.
https://github.com/Blinue/Magpie/discussions/844

1,359 (edited by dawkinscm 27-03-2024 21:19:11)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:

With TRT 10.0 my RTX 4070 struggles to 24>96 hd source (4.16 lite realtime), but easy 24>120 with TRT 9.2 hehe!
Maybe you know solution, why any models after 4.10 not smooth enough? But difference between 4.12 and 4.4 a whole pit, but SMOOTHNESS drop?
Maybe its frame pacing problem, just listen, 4.4v2 24>72 looks very smooth, but has a lot artefacts (no dropped frames), starting 4.10 everything looks like every 3th frame are mismatched (still no dropped frames)!

As I said, trt 10.0 is "one to avoid" because it cuts performance by around 30% while possibly doubling GPU usage.


aloola wrote:

has anyone tried the option builder_optimization_level=5?
The resulting engine may have better performance compared to an engine built with a lower optimization level.

They key phrase there is "may" have better performance. Yes I've tried this a couple of times. It's supposed to try to find more potential heuristics from what I understand but I didn't notice any real difference. But I can't remember if I have tried with my increased workspace so I might try again.

1,360 (edited by RickyAstle98 27-03-2024 21:32:12)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:

With TRT 10.0 my RTX 4070 struggles to 24>96 hd source (4.16 lite realtime), but easy 24>120 with TRT 9.2 hehe!
Maybe you know solution, why any models after 4.10 not smooth enough? But difference between 4.12 and 4.4 a whole pit, but SMOOTHNESS drop?
Maybe its frame pacing problem, just listen, 4.4v2 24>72 looks very smooth, but has a lot artefacts (no dropped frames), starting 4.10 everything looks like every 3th frame are mismatched (still no dropped frames)!

As I said, trt 10.0 is "one to avoid" because it cuts performance by around 30% while possibly doubling GPU usage.


aloola wrote:

has anyone tried the option builder_optimization_level=5?
The resulting engine may have better performance compared to an engine built with a lower optimization level.

They key phrase there is "may" have better performance. Yes I've tried this a couple of times. It's supposed to try to find more potential heuristics from what I understand but I didn't notice any real difference. But I can't remember if I have tried with my increased workspace so I might try again.

But what TRT doing in my case? No drops no stutters but not smooth (any after 4.10), even with new optimization level, ah yes wait >
Builder optimization level 5 (default 3), adds another 3 minutes to build engine cache lock and only 3% performance!

1,361 (edited by dawkinscm 27-03-2024 21:46:20)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:

But what TRT doing in my case? No drops no stutters but not smooth (any after 4.10), even with new optimization level, ah yes wait >
Builder optimization level 5 (default 3), adds another 3 minutes to build engine cache lock and only 3% performance!

Yeah I just tried it and if it is making a difference, it's at the margins and maybe pushing 4.15 lite closer to 4.15. But I will need to test with 4.15 to be sure. Also I'm not used to waiting this long for engine build anymore lol.

1,362 (edited by RickyAstle98 27-03-2024 21:53:22)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:

But what TRT doing in my case? No drops no stutters but not smooth (any after 4.10), even with new optimization level, ah yes wait >
Builder optimization level 5 (default 3), adds another 3 minutes to build engine cache lock and only 3% performance!

Yeah I just tried it and if it is making a difference, it's at the margins and maybe pushing 4.15 lite closer to 4.15. But I will need to test with 4.15 to be sure. Also I'm not used to waiting this long for engine build anymore lol.

Simple test with fastest model >
4.4 opt level 1 > engine build time ~32 seconds (-2% performance)
4.4 opt level 2 > engine build time ~70 seconds (-1% performance)
4.4 opt level 3 > engine build time ~120 seconds *
4.4 opt level 5 > engine build time ~300 seconds (+3% performance)

1,363 (edited by RickyAstle98 27-03-2024 21:52:02)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:

But what TRT doing in my case? No drops no stutters but not smooth (any after 4.10), even with new optimization level, ah yes wait >
Builder optimization level 5 (default 3), adds another 3 minutes to build engine cache lock and only 3% performance!

Yeah I just tried it and if it is making a difference, it's at the margins and maybe pushing 4.15 lite closer to 4.15. But I will need to test with 4.15 to be sure. Also I'm not used to waiting this long for engine build anymore lol.

Hehe!

1,364 (edited by dawkinscm 27-03-2024 21:59:02)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:
dawkinscm wrote:
RickyAstle98 wrote:

But what TRT doing in my case? No drops no stutters but not smooth (any after 4.10), even with new optimization level, ah yes wait >
Builder optimization level 5 (default 3), adds another 3 minutes to build engine cache lock and only 3% performance!

Yeah I just tried it and if it is making a difference, it's at the margins and maybe pushing 4.15 lite closer to 4.15. But I will need to test with 4.15 to be sure. Also I'm not used to waiting this long for engine build anymore lol.

Hehe!

Update:
I think my initial impressions were correct. For certain artefacts, Rife v4.15 lite 72fps works almost as well as Rife 4.15 60fps. For others they are about the same with both running at 60fps. So Rife v4.15 lite 72fps is not quite as smooth as 60fps but it minimises certain artefacts while being  smooth enough to not be a problem.

1,365 (edited by RickyAstle98 27-03-2024 22:04:09)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:
dawkinscm wrote:

Yeah I just tried it and if it is making a difference, it's at the margins and maybe pushing 4.15 lite closer to 4.15. But I will need to test with 4.15 to be sure. Also I'm not used to waiting this long for engine build anymore lol.

Hehe!

Update:
I think my initial impressions were correct. For certain artefacts, Rife v4.15 lite 72fps works almost as well as Rife 4.15 60fps. For others they are about the same with both running at 60fps. So Rife v4.15 lite 72fps is not quite as smooth at 60fps but it minimises certain artefacts while being  smooth enough to not be a problem.

In my case problem not with artefacts, frames are mismatched or delayed a bit!

1,366 (edited by dawkinscm 27-03-2024 22:07:20)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:
dawkinscm wrote:
RickyAstle98 wrote:

Hehe!

Update:
I think my initial impressions were correct. For certain artefacts, Rife v4.15 lite 72fps works almost as well as Rife 4.15 60fps. For others they are about the same with both running at 60fps. So Rife v4.15 lite 72fps is not quite as smooth at 60fps but it minimises certain artefacts while being  smooth enough to not be a problem.

In my case problem not with artefacts, frames are mismatched or delayed a bit!

Is that for build_optimization or running at 72fps?

aloola wrote:

has anyone tried the option builder_optimization_level=5?

BTW Thanks for the reminder. The last time I tried this I remember seeing warnings generated, possibly because it was running out of workspace. Now I get no more errors and I think it does help a little.

1,367 (edited by RickyAstle98 27-03-2024 22:15:45)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:
dawkinscm wrote:

Update:
I think my initial impressions were correct. For certain artefacts, Rife v4.15 lite 72fps works almost as well as Rife 4.15 60fps. For others they are about the same with both running at 60fps. So Rife v4.15 lite 72fps is not quite as smooth at 60fps but it minimises certain artefacts while being  smooth enough to not be a problem.

In my case problem not with artefacts, frames are mismatched or delayed a bit!

Is that for build_optimization or running at 72fps.

My RTX 4070 : 4.4 to 4.9 models perfectly smooth at any factors at any fps (no build optimization or smth)
Models 4.10 to 4.16 not smooth at all (looks like every Xth frame delayed or mismatched like stutters every 1 second)
Update : opt level 1 helps recover smoothness for 4.10 to 4.14 models!

1,368 (edited by dawkinscm 27-03-2024 22:19:32)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:
dawkinscm wrote:
RickyAstle98 wrote:

In my case problem not with artefacts, frames are mismatched or delayed a bit!

Is that for build_optimization or running at 72fps.

My RTX 4070 doing perfect smooth 4.4-4.9 models, 4.10+ models not smooth, with or without build optimization or running at 72fps or dropped frames...
Update : opt level 1 helps 4.10 to 4.14 models for smoothness...

That's weird but I am interested to see the rest of your findings. But I don't like the fast action artefacts that models below 4.15 produce. Running at 72fps there are some slow pan issues on a couple of movies but for now I will stick with v4.15 lite/72fps.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:
dawkinscm wrote:

Is that for build_optimization or running at 72fps.

My RTX 4070 doing perfect smooth 4.4-4.9 models, 4.10+ models not smooth, with or without build optimization or running at 72fps or dropped frames...
Update : opt level 1 helps 4.10 to 4.14 models for smoothness...

That's interesting but I don't like the fast action artefacts the models below 4.15 produce. Running at 72fps there are some slow pan issues on a couple of movies but for now I will stick with v4.15 lite/72fps with maybe the occasional dip back down to 60fps if I see any major issues for a particular movie.

Please reatach my reedited comment again, dont reply to it, will be deleted smile

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:

Please reatach my reedited comment again, dont reply to it, will be deleted smile

I deleted my reply so i don't have anything to reattach. Don't worry about it smile

1,371 (edited by RickyAstle98 28-03-2024 06:17:49)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
RickyAstle98 wrote:

Please reatach my reedited comment again, dont reply to it, will be deleted smile

I deleted my reply so i don't have anything to reattach. Don't worry about it smile

*DELETED*

1,372

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

1080@x5 HAGS OFF 4t build 5 in 331.55 seconds
Output 8000 frames in 45.79 seconds (174.70 fps) 4.15 lite
Output 8000 frames in 52.86 seconds (151.35 fps) 4.15

1080@x5 HAGS OFF 4t build 4 in 101.19 seconds
Output 8000 frames in 37.26 seconds (214.68 fps) 4.15 lite
Output 8000 frames in 54.36 seconds (147.16 fps) 4.15

1080@x5 HAGS OFF 4t build 3 in 70.20 seconds
Output 8000 frames in 39.49 seconds (202.59 fps) 4.15 lite
Output 8000 frames in 51.14 seconds (156.42 fps) 4.15

1080@x5 HAGS OFF 4t build 2 in 41.65 seconds
Output 8000 frames in 36.79 seconds (217.45 fps) 4.15 lite
Output 8000 frames in 51.62 seconds (154.99 fps) 4.15

1080@x5 HAGS OFF 4t build 1 in 41.60 seconds
Output 8000 frames in 36.44 seconds (219.55 fps) 4.15 lite
Output 8000 frames in 52.00 seconds (153.83 fps) 4.15

1080@x5 HAGS OFF 4t build 0 in 22.14 seconds
Output 8000 frames in 42.09 seconds (190.09 fps) 4.15 lite
Output 8000 frames in 63.52 seconds (125.95 fps) 4.15

4Kx2 HAGS OFF 4t build 0 in 23.42 seconds
Output 2000 frames in 36.49 seconds (54.80 fps) 4.15 lite
Output 2000 frames in 51.31 seconds (38.98 fps) 4.15

4Kx2 HAGS OFF 4t build 1 in 77.06 seconds
Output 2000 frames in 33.16 seconds (60.32 fps) 4.15 lite
Output 2000 frames in 39.89 seconds (50.14 fps) 4.15

4Kx2 HAGS OFF 4t build 2 in 88.97 seconds
Output 2000 frames in 33.50 seconds (59.69 fps) 4.15 lite
Output 2000 frames in 40.41 seconds (49.49 fps) 4.15

4Kx2 HAGS OFF 4t build 3 in 135.63 seconds
Output 2000 frames in 33.19 seconds (60.26 fps) 4.15 lite
Output 2000 frames in 38.83 seconds (51.51 fps) 4.15

4Kx2 HAGS OFF 4t build 4 in 172.76 seconds
Output 2000 frames in 34.21 seconds (58.46 fps) 4.15 lite
Output 2000 frames in 39.08 seconds (51.17 fps) 4.15

4Kx2 HAGS OFF 4t build 4 in 566.31 seconds
Output 2000 frames in 33.42 seconds (59.85 fps) 4.15 lite
Output 2000 frames in 39.04 seconds (51.23 fps) 4.15


well just stick with build 3 (default) or build 2 for faster build

1,373 (edited by unreality 29-03-2024 10:14:59)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Hello everyone,

I would like to play back 50 Hz with MPV (implemented in SVP) because my i9 14900 with DDR5 6200 and RTX 4090 probably can't play 2.5 speed at 4K. So I have to play back at 2x (48p) but the TV does 50hz. is there a possibility? Can't you fix something at MPV?

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

unreality wrote:

but the TV does 50hz

Try to search "target" in the Application Settings and specify the exact value of your monitor:
https://gyazo.com/e9ccf345121d821d3180a40625c49bb4

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Nice smile

I will try !

Thank you