SHTH34D wrote:

Hmmm, either something is wrong with my configuration or we have different hardware. I watch 4k HDR movies at full HDR10 quality, aiming for 60fps. I have a 7800x3d with 32GB DDR5 6600mhz RAM in a X670-I Strix motherboard and a 4090. If I choose any setting above RIFE 4.9 and/or above Movie 2x (even 50fps) it becomes an unwatchable, stuttery mess. I was told in a different thread this was due to bandwidth limitations. It is possible I have something configured incorrectly. Is it as simple as placing the extracted RIFE models in the correct folder, then selecting them in SVP RIFE settings? One thing that has been bugging me is when the command prompt pops up setting the timing, I see it says something about f32 timing being unable to continue and selects f16. The command prompt also says resolution of 3840x2400 when I'm running at 3800x2160, which may help explain my poor performance. I looked for a way to change that setting but I haven't found it anywhere.


My RAM is 6600mhz at CL30 so could potentially be ram? Also I'm using MPV not MPClassic?

Why? The 4090 can do x2 with 4.15 but it's near perfect now in terms of artifacts. I'm so happy with it. Don't get me wrong x3 would be better but that's one for the future.

I cant seem to run 4k x3 on my rig 6600mhz (64gb) 13900KS @ 5.7Ghz (all core). Thats 10bit HDR though? (4090).

reconhell wrote:
Mardon85 wrote:

I can also confrim rife v9.15 v2 is awesome. Testing on Avatar (1) flight scenes and its much improved.

9.15? you mean 4.15?

I do indeed.

I can also confrim rife v9.15 v2 is awesome. Testing on Avatar (1) flight scenes and its much improved.

Sorry by "this" I mean Player led Dolby Vison.

https://www.reddit.com/r/htpc/s/GUgcGIZvfO

Any chance we could get this working with SVP?

Would be great to get DV working on my HDR10 montior.

I had to do a full reinstall and it now works.

I love how much quicker 4.9 is at compiling.
There does seem to be a bug where it doesn't like to get going after pausing which I've not seen before. It stutters down to 1FPS. I have to pause, take it back a couple of seconds then press play.

I can't do x3 movie speed in 4K HDR in 4.9 like I did with 4.6 is this expected behaviour?

Is there anyway to move the old cache into the new location to save caching all the resolutions again?

EDIT

Ok now I have no idea what is going on. I rebooted my machine and 4.9 has gone entirely and RIFE isn't kicking in at all??

It usually does it for all the different frame sizes. Once its done it once per frame size though it doesn't happen again.

UHD wrote:
zerosoul9901 wrote:

From my tests, using ensemble models improves frame interpolation quality, while v2 models significantly reduces the playback seek time, improve performance and should also reduce RAM bandwidth requirements.

Thanks, that's very good news smile

Please can you elaborate on "And maybe remove explicit padding, I am not a programmer." So I can get this installed and tested please?

Cheers

Update I tried the files about (its probably user error) but I couldn't get them to work. Hopefully the SVPTeam will issue an offical update with them in?

Erm if this isn't supposed to be there it's possibly left over from tweaks we had to make before it was officially implemented?

UHD wrote:

Thanks Mardon85 for the further tests and I'm very glad you found a way to interpolate x3 in real time. I think the setting you showed might also help someone.

One more thing can increase efficiency:

scripts/vsmlrt.py: added support for rife v2 implementation
(experimental) rife v2 models can be downloaded on https://github.com/AmusementClub/vs-mlr … nal-models ("rife_v2_v{version}.7z"). It leverages onnx's shape tensor to reduce memory transaction from cpu to gpu by 36.4%. It also handles padding internally so explicit padding is not required.

This update came out a few days ago: https://github.com/AmusementClub/vs-mlr … c649dfb212

I guess all you need to do is replace the vsmlrt.py file and download the rife v2 models. And maybe remove explicit padding, I am not a programmer.

Share your impressions on how this modification, and what Mardon85 suggests, affects performance.

I'll give this a go and report back.

Ok i've figured it out.
HAGS made zero difference BTW.

The key is Nvidia power management in control panel. Set this for MPV player (i've not got MPC working yet) not globally:

https://i.imgur.com/Uh2nwx5.png

As soon as you set this to high the playback is smooth at x3 however look at the power useage vs x2. Perhaps I can play around to find the lowest possible settings to run at 3x's when I have some more time:

x3 (Maximum Performance)
https://i.imgur.com/HVREPrR.png

x2 (Normal Power usage)
https://i.imgur.com/BY6uCqX.png

My SVP settings are as follows:

https://i.imgur.com/SBPaBcz.png

x4 does not work.

So I guess pay your money take your choice.

Edit I've played around with this now and get power usage down somewhat. I can't go any lower on the core than 2015mhz a or else the voltage jumps back up to 1.05v for some reason? I've also downclocked the memory.

https://i.imgur.com/KwLcrTq.png

This is a decent and more consistent way of checking latency using an official intel back end tool:


https://github.com/FarisR99/IMLCGui

6400mhz Dual Rank (64Gb) 32-38-38-85

https://i.imgur.com/wQsUhOv.jpg

UHD wrote:
Mardon85 wrote:

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

You've been away from us for a month and a half. Nice to see you Mardon85 again smile

NVIDIA GeForce RTX 4090 graphics card and DDR5-6400 memory is an excellent set up to test the capabilities of RIFE. It's a bit puzzling that you can't achieve x3 interpolation, especially since if I understood one of your earlier posts correctly, for x2 interpolation the NVIDIA GeForce RTX 3090 graphics card was completely sufficient.

Mardon85 wrote:

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.


https://www.svp-team.com/forum/viewtopi … 686#p81686

Write more about the test parameters:

1 What is your maximum refresh rate of your monitor or TV set? 100Hz? 120Hz? 3440x1440 175hz HDR
2 Are you using G-Sync or FreeSync automatic refresh rate change? - Gsync
3. Do you use the same settings that earl088 used successfully for x3 interpolation? I NEED TO CHECK THIS AND REPORT BACK
https://www.svp-team.com/forum/viewtopi … 799#p81799
4. Do you use the "Hardware-accelerated GPU scheduling OFF" setting that aloola suggests for improved performance? I use it on due to gaming on system also.
https://www.svp-team.com/forum/viewtopi … 819#p81819
5. Write something more about the 21:9 4k HDR movie you are testing. Is it a 3840x2160 23.976FPS file with black bars at the bottom and top or does it have a different resolution and FPS? I scale everything down to by 21:9 screen so the black bars are completely gone and my entire screen is filled.
6. Using the file below, can't you interpolate in real time x3? I NEED TO CHECK THIS AND REPORT BACK
LG 4K HDR Demo - New York.ts.
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS.
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits.

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

At the moment we need to find a way for you to be able to interpolate 4K HDR x3 in real time like others with NVIDIA GeForce RTX 4090 graphics cards.

If that works, then we'll try x4. I've got some new ideas for performance enhancements that haven't come up here yet for nowwink

I've filled in some clarifications above.

UHD wrote:

Who wants to interpolate 4K HDR videos x5 in real time with RIFE?
Perhaps a more appropriate question is who can afford it?

After reading all the posts on this thread I come to the conclusion that it is possible, and the limitation is not the NVIDIA GeForce RTX 4090 graphics card but the RAM bandwidth.

For someone with unlimited financial resources this is the solution:

ASUS Pro WS W790E-SAGE SE motherboard
Intel Xeon W9-3495X processor
G.SKILL DDR5-6400 CL32-39-39-102 octa-channel R-DIMM memory modules

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/06-zeta-r5-rdimm-spec-table-eng.png
Source: https://www.gskill.com/community/150223 … erformance

The result?

303.76GB/s read, 227.37 GB/s write, and 257.82 GB/s copy speed in the AIDA64 memory bandwidth benchmark, as seen in the screenshot below:

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/04-zeta-r5-rdimm-ddr5-6400-c32-16gbx8-bandwidth.png
Source: https://www.gskill.com/community/150223 … erformance

Of course, the Intel Xeon W9-3495X is completely out of my reach....

The cheapest unlocked Intel Xeon would be the W5-2455X at a suggested price of $1039: https://www.anandtech.com/show/18741/in … -5-0-lanes Should be enough. If the current dual-channel DDR5-6000 allows x3 interpolation then the quad-channel DDR5-6400 should be enough for x5 real-time interpolation.

I am looking for someone who has an NVIDIA GeForce RTX 4090 graphics card, at least DDR5-6000 memory and some spare time to test how RIFE real-time interpolation scales at different RAM speeds.

Alternatively, someone who would like to build an HTPC based on quad-channel or octa-channel DDR5-6400 R-DIMM memory. Octa-channel is for the 4K 240Hz screens that will soon go on sale big_smile

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

I was keen to try this out on my Laptop. Its got a 3050ti with 4Gb of memory. Using the 4.4 engine I get the following:

[01/16/2023-21:47:02] [W] [TRT] Skipping tactic 0x0000000000000000 due to exception autotuning: CUDA error 2 allocating 849350061-byte buffer: out of memory

Any way to run this on 4GB of Vram?

Chainik wrote:

SVP updated, added TensorRT (no need for doing anything manually), fixed (??) possible audio desync after RIFE transcoding (both Vulkan and TRT versions)

Either select the checkbox at install time, or install an additional package called "TensorRT" via SVP menu -> Utilities -> Additional programs and features.

----
It uses "dynamic shapes" by default, i.e. only ONE optimization pass for all resolutions below 2560*1440. And if/when you open a 4K video then it'll do another pass for resolutions from 1440p to 4K.
BUT! this can be a little bit slower than optimization for a specific resolution, like 5% in my case. This is why there's a "performance boost" profile option - it forces its own opt. pass for each resolution.

another finding: model 4.6 needs more than 8G of device memory for 4K res, so if you're on a 8G card and want 4K then choose model 4.4.

----
Also installation scripts fixed so the Vapoursynth Filter must be registered automatically.

Excellent thank you.

I could do with this also please.

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.

Interestingly I tried a 21:9 4h HDR video after the LG one at x3 and when in window mode it ran correctly. As soon as I double clicked to go full screen the film dropped to 9fps. Looks more like a configuration issue than RIFE as it was running fine windowed.

UHD wrote:
Mardon85 wrote:

Ok I got it working with a 4K SDR video. Wow brilliant stuff. I'm not sure if its working with HDR though. Its x2 frame rate but the HDR colours don't seem to be coming through.

Have you tried the following file in real time?

video test:
LG 4K HDR Demo - New York.ts.
3840x2160, HDR10, 25FPS
Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

Can you smoothly interpolate in real time with RIFE x2, without losing frames? How are the colours?

I'll do some further tests today and report back.

For reference my system is a 10900k @ 5.2ghz all core 32gb of CL14 4000mhz ram (not sure if very low latency or bandwidth plays the bigger factor here). Also works at x3 resolution in HDR.

The 4090 is mind blowing like x2 generational leap over my 3090. It so frugal on energy too!

EDIT----

Ok i've tested this further. Through MPlayer HDR works with Standard SVP interpolation (but not Rife). However since brining in all the new RIFE updates it seems to have broken HDR in MPV player. Even when using standard interpolation with Rife off MVP/SVP player is not playing HDR (even when turned off). I've even tested MPV on its own without SVP and it is not displaying HDR colours. I've posted my config file below for info:

Any ideas?

------------------
#
# THIS FILE WILL BE OVERWRITTEN WITH THE PACKAGE UPDATE
# Use %APPDATA%/mpv/mpv.conf
# OR SVP's menu -> Information -> Add. information -> mpv config. file
#     to define your own customized configuration
#
# Sample mpv configuration
#

# this is required for SVP to "catch" the mpv
input-ipc-server=mpvpipe

# hardware video decoder
hwdec=auto-copy
hwdec-codecs=all

# high quality video output, require rather fast video card
#profile=gpu-hq

# D3D11 renderer (default) is required for the HDR playback
#gpu-api=d3d11

# use VULKAN API if you have problems with the default d3d11 renderer
#gpu-api=vulkan

# miscellaneous options

# comment this one if you want mpv to remember the playback position
save-position-on-quit=yes

# fixes audio desync
hr-seek-framedrop=yes

#log-file=mpv.log
# this is required for SVP to "catch" the mpv
input-ipc-server=mpvpipe
hwdec=nvdec-copy
#hwdec=auto-copy

vo=gpu-next

-----------------

FINAL EDIT --- Adding this here incase anyone has the same issue. I needed to add the following to the config file:

--vo=gpu-next --target-colorspace-hint=yes --gpu-api=d3d11

The image clip you provided now plays at 50fps in HDR and looks fantastic.

One very happy camper here. Thanks everyone for your effors.

Ok I got it working with a 4K SDR video. Wow brilliant stuff. I'm not sure if its working with HDR though. Its x2 frame rate but the HDR colours don't seem to be coming through.

Chainik wrote:

That one - https://github.com/AmusementClub/vs-mlrt - is MUUUUCH better
-------------
Post updates:
09/01: updated both libs and scripts, should improve 4K performance on 4080+
-------------
Let's try this:

0. nothing to do with Python big_smile
1. download --> https://www.svp-team.com/files/temp/rife-trt-0901.7z <--, unpack into SVP 4\rife (you should already have this folder), so vstrt.dll must be in the root, i.e. SVP 4\rife\vstrt.dll
2. replace generate.js, base.py in SVP 4\script; restart SVP to be sure
3. menu -> Applications settings -> Additional options -> All settings, go to 'User defined options'
Title: TensortRT; Script name: rife_trt; Other values by default - "FRC profile", "ON or OFF"
Click 'Add option'
Go to the RIFE video profile, see the added TensortRT on/off swtich.
Make a copy of the RIFE video profile, one with TensorRT ON and another with OFF.

Pros:
- no Pytorch!
- works in a real-time
- even faster (?) than vsrife [could be just because of some TensorRT options]
Cons:
- even slower (?) first-time initialization [could be just because of some TensorRT options]
- a nasty command-line window will pop-up for every new video resolution

It's OK for the command-line window to stay for 4-5 mins. Don't close it! Wait!

I've been a long time follower of the thread and now a very proud owner of a 4090. I can't wait to try out some 4K HDR RIFE!

Can you elaborate on point 3 or perhaps show a screen shot of your Application Settings window?

EDIT - Doesn't matter I sorted it. Patiently and excited waiting for the command line to finish big_smile

EDIT 2 - Got it working but need some assistance. My monitor is an ultrawide and the content i'm trying to watch is 21:9 it doesn't seem to zoom to fit like it does with the out of the box SVP player. Any ideas?

Should the window close after "Global timing cache in use. Profiling results in this builder pass will be stored." or keep waiting?