Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!
please update now, 12_lite will work w/o renaming...
You are not logged in. Please login or register.
SmoothVideo Project → Using SVP → New RIFE filter - 3x faster AI interpolation possible in SVP!!!
please update now, 12_lite will work w/o renaming...
For those who have more technical knowledge, this it's good for us, right?
https://www.google.com/amp/s/www.techpo … face%3famp
I saw this one too. It should come this month
how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?
how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?
My brain only saw "NVIDIA RTX architecture for accelerating" sorry
Guys, I am so confused. Everything seems to be so complex. I have been reading this thread for hours now...
I am running SVP via RIFE and MPV. SVP CPL shows it is using RIFE v 4.4.
How do I update to the latest version of RIFE for live conversion?
A simple list of instructions would be wonderful, thank you
> Everything seems to be so complex.
then you don't need to "update to the latest version of RIFE"
stick to what is provided with SVP
How do I update to the latest version of RIFE for live conversion?
A simple list of instructions would be wonderful, thank you
First you update SVP to latest version by right clicking it from task bar --> Utilities --> Additional programs and features... --> Update components --> Next >
https://gyazo.com/1702ec66e0a1210c4f4d25fdfbe34aeb
If you're equipped with an Nvidia Graphics GPU, amplify your interpolation speed by installing TensorRT. Check out the SVP default guide for a smooth installation process:
https://www.svp-team.com/wiki/RIFE_AI_interpolation
Dive deeper into the videos enhancement journey. If the latest stable version doesn't quite satisfy your expectations, explore the cutting-edge experimental versions with the latest improvements. You can always revert to older models if needed.
Download latest RIFE from the bottom of the page here:
https://github.com/AmusementClub/vs-mlr … nal-models
But the fastest model seems to be rife_v4.6.onnx from rife_v2 folder of rife_v2_v4.7z :
https://github.com/AmusementClub/vs-mlr … e_v2_v4.7z
The current RIFE model version number recommended by it's developer is mentioned here:
https://github.com/hzwer/Practical-RIFE … erpolation
Then copy the contents of the rife folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\rife")
and copy the contents of the rife_v2 folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\rife_v2"):
https://gyazo.com/b2de1180de4f68b82d333c9eee5e60f2
How the files should look if copied correctly:
https://gyazo.com/e6c8e536288ea4af68a3cc438d1e1083
Restart SVP to see the newly added models.
How to upgrade TensorRT:
Go to https://github.com/AmusementClub/vs-mlrt/releases/ and download latest vsmlrt-windows-x64-tensorrt archive.
There may be fixes and enhancements in the latest releases. If you're willing to help test, i would try unzipping
vstrt.dll
and the folder
vsmlrt-cuda
into
C:\Program Files (x86)\SVP 4\rife
Now, with a seamlessly upgraded RIFE AI model, enjoy the next level of videos interpolation.
Happy watching!
List of SVP4 SETTINGS you can change to improve RIFE FPS for a smooth experience even on low end PC:
Use SVP's MPV video player instead of MPC-HC video player by installing it from SVP icon tray right click --> Utilities --> Additional programs and features... --> Add or remove components
Turn off Hardware Accelerated GPU Scheduling:
https://www.howtogeek.com/756935/how-to … indows-11/
Turn off GPU decoder in player:
If you're using SVP's MPC-HC you go to View->Options->Internal Filters->Video decoder->Hardware Acceleration->None
https://gyazo.com/93b27111fe9a43f1f6e0a49f46435e14
Also go to Options->Playback->Output->MPC Video Renderer Settings and uncheck "Adjust the frame presentation time" so your frame rate can go above 160 fps:
https://gyazo.com/ebfa6f747d2e0fc3d3f03c64bb3c9468
if you're using SVP's MPV then go to C:\Program Files (x86)\SVP 4\mpv64 and edit the file mpv.conf and edit this line:
hwdec=auto-copy change to #hwdec=auto-copy. Just remove the "#" if you want to use it again.
Go to Windows Power & Battery settings and change Power mode from Balanced to Best Performance:
https://gyazo.com/7666c5fbe11d421020f7a38ed04fe425
Enable Performance Boost for Nvidia TensorRT so the video starts faster:
https://gyazo.com/ab75720ef3674dc2c0ad390e5087221e
Also make sure you set GPU Threads to 2 for a stable FPS!!!
Setting it to 1 GPU Thread will give it too less memory to work with. Setting it to 3+ will make it drop frames more, without any noticeable improvements.
Duplicate frames removal setting we want it on "Do not remove".
For the Soap Opera effect increase Scene change threshold to 100% (rife_sc in SVP Application settings) so it will always interpolate the source frames and never repeat them:
Example: https://gyazo.com/f969dd0efaf116e91713f8d2ecdfbb45
Add resize SVP Application parameter with a small resolution for SVP to downscale the video before interpolating without overwhelming your GPU if you want to play 4K resolution videos:
Possible values:
-1 (your current screen size)
-25601440 (2560x1440 pixels for 2K)
-19201080 (1920x1080 pixels for 1080p)
-12800720 (1280x720 pixels for 720p)
-10240576 (1024x576 pixels for 576p)
-08540480 (854x480 pixels for 480p)
Example: https://gyazo.com/cdd546a9c5e2efafaf9dd6d671fe00a8 and enable "Stretch to Window" in MPC-HC so you can see the resized video on whole screen https://gyazo.com/4e8b2532e2bd1cd9868f9d03e74dc2b6
To accurately measure your current frames per second (FPS), you should install NVIDIA App from here:
https://www.nvidia.com/en-us/software/nvidia-app/
And enable Statistics in the NVIDIA Overlay:
https://gyazo.com/a17a74b5b071a3d8c137c17a67ad00d4
BONUS:
In my experiments, I found that while MPC-HC struggles, MPV seamlessly drops frames and continues.
Additionally, aloola's analysis suggests that newer models demand more from your system, yet they offer substantial enhancements in interpolation. MPV supports the addition of shaders which can significantly improve image quality and sharpness. A clever workaround involves resizing a 4K image to 1080p for swift interpolation with RIFE on newer models, and then applying shaders to emulate the appearance of the original 4K quality.
Although the result won't exactly match the original source, it ensures a smooth viewing experience. Moreover, your GPU will handle it effortlessly, as upscaling is far less resource-intensive than interpolating a 4K HDR10 image.
Feel free to experiment with these techniques yourself:
MPV upscaling config: https://drive.google.com/drive/folders/ … MSSZq0jJGj
If you have an HDR monitor, enable RTX HDR in your media player for all videos you watch with:
https://www.nexusmods.com/site/mods/781
RAGEdemon wrote:How do I update to the latest version of RIFE for live conversion?
A simple list of instructions would be wonderful, thank you
The brilliant SVP developers made it extremely easy to install.
First you update SVP to latest version by right clicking it from task bar --> Utilities --> Additional programs and features... --> Update components --> Next >
https://gyazo.com/1702ec66e0a1210c4f4d25fdfbe34aeb
Then you download latest RIFE from the bottom of the page here:
https://github.com/AmusementClub/vs-mlr … nal-models
Currently the latest one is this 2 days ago archive:
https://gyazo.com/637173b715eac98073928e66946ef256
Then you copy the contents of the folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\"):
https://gyazo.com/6f2c1eff9a6a459fbd411faa11efbacb
How the files should look if copied correctly:
https://gyazo.com/2f640fe54815c061392cd0760dc37624
Please restart SVP. If done correctly, you should be able to select the new version from the AI model list.
Enjoy!
Amazing, Thank you!
+ An addition for some of us oldies - the RIFE TensorRT Engine does not show up until you go into the components and install the new RIFE/TensorRT Option. Then it will work!
Are there any options you would suggest? I see people have set GPU threads to 4 (default 2). And you are using the lite version, vs the standard version...
thanks again - very helpful. I think your post will be reverenced many times going into the future...
I think your post will be reverenced many times going into the future...
Everything needed is already on this SVP manuals page https://www.svp-team.com/wiki/RIFE_AI_interpolation The extra stuff you've seen some of us doing here is interesting but not necessary for Rife. Especially since the SVP devs recently created a script that does most of the extra stuff for you.
The instructions you need are as follows:
1. Download and install SVP.
2. Follow the Rife AI manuals page.
3. Restart SVP.
4. Don't worry about the experimental stuff myself and others are doing because for most it's more likely to break your install than help it.
What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?
What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?
Very little difference. So try both and let us know what you think.
What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?
4.12 lite works a bit better on hardsubs and character borders, and a bit slower than 4.9, but 2080 Ti is still capable of 1080p24 x3 with Anime4K (to 2560x1440)
After trying 4.9 VS 4.12 Lite at least on performance aspect I can't see any difference at 4K on RTX4090 & i9 11900K. Same usage & power draw on both.
After trying 4.9 VS 4.12 Lite at least on performance aspect I can't see any difference at 4K on RTX4090 & i9 11900K. Same usage & power draw on both.
Yep. There may or may not be differences between the two for Anime. But for live action I couldn't find a clear difference although 4.12 might be slightly better for fast motion.
Will this driver scheduled for later today promising 5x the performance increase for TensorRT-LLM for 3000 and 4000 series GPU's have an impact on us using RIFE? I assume no.
Or will this improve performance for us? Or maybe something that needs a RIFE update to utilise version 0.6.0 benefits? Not sure. Just asking.
NVIDIA states a 5x performance boost with TensorRT-LLM v0.6.0 which will be available later this month
Will this driver scheduled for later today promising 5x the performance increase for TensorRT-LLM for 3000 and 4000 series GPU's have an impact on us using RIFE? I assume no.
Or will this improve performance for us? Or maybe something that needs a RIFE update to utilise version 0.6.0 benefits? Not sure. Just asking.
NVIDIA states a 5x performance boost with TensorRT-LLM v0.6.0 which will be available later this month
how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?
Yep, thanks. As suspected. It won't be connected to SVP or RIFE performance lift.
New version 4.13_Lite just got posted here: https://github.com/AmusementClub/vs-mlr … nal-models
Happy testing
New version 4.13_Lite just got posted here: https://github.com/AmusementClub/vs-mlr … nal-models
Happy testing
Yeah I saw it earlier but I didn't bother to update because after testing it doesn't seem to be any different from 4.12lite or v9. I will wait for a full v4.13 or maybe 4.14 before commenting on here.
I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.
I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.
Sometimes the encoder source could cause problems too so maybe try to find the same anime from another encoder.
I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.
For animation, 4.12 or 4.13 is definitely better.
I've been using 4.12 for animation only.
I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.
For anime with a lot of hardcoded subtitles, try a model >= 4.10, even 4.12_lite is much better than 4.9.
When you download new rife you get 2 folders. normal and V2, which to use?
Also which is better lite or normal rife?
@Chainik regarding "Scene Change Threshold", it's interesting how it works like artifact masking in the past. 15% provides the smoothest panning shots and the most artifacts. 6% shows the least artifacts, but less smoothness. 1% (set manually from all settings) has ZERO artifacts, but LEAST smoothness.
No dropped frames at all changing between percentages, but smoothness changes. Is there a way RIFE can improve smoothness while that percentage is lower? For example if we can achieve the smoothness of 15% at 3% it would be amazing, even better if we can achieve that smootheness at 1% to eliminate all artifacts, WOW that would be the dream.
Testing artifacts - One of the best scenes:
007 No Time To Die, around 3 minutes & 10 seconds, the sliding glass door with the masked man behind it walking towards it and opening it, huge difference can be noticed between 15%, 6%, and 1%.
Then when the masked man enters the room, the curtains in the background flickering in older versions of RIFE, such as 4.6, but solved in 4.9 for example and newer versions.
Then after 14 minutes, after the explosion, the action scene has a lot of panning shots that make it good for determining smoothness as well.
SmoothVideo Project → Using SVP → New RIFE filter - 3x faster AI interpolation possible in SVP!!!
Powered by PunBB, supported by Informer Technologies, Inc.