1,001

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

please update now, 12_lite will work w/o renaming...

1,002

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Drakko01 wrote:

For those who have more technical knowledge, this it's good for us, right?
https://www.google.com/amp/s/www.techpo … face%3famp

I saw this one too. It should come this month

1,003

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?

1,004

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Chainik wrote:

how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?

My brain only saw "NVIDIA RTX architecture for accelerating" sorry

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Guys, I am so confused. Everything seems to be so complex. I have been reading this thread for hours now...

I am running SVP via RIFE and MPV. SVP CPL shows it is using RIFE v 4.4.

How do I update to the latest version of RIFE for live conversion?

A simple list of instructions would be wonderful, thank you smile

1,006

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

> Everything seems to be so complex.

then you don't need to "update to the latest version of RIFE"
stick to what is provided with SVP

1,007 (edited by flowreen91 13-01-2024 11:38:18)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RAGEdemon wrote:

How do I update to the latest version of RIFE for live conversion?

A simple list of instructions would be wonderful, thank you smile

First you update SVP to latest version by right clicking it from task bar --> Utilities --> Additional programs and features... --> Update components --> Next >
https://gyazo.com/1702ec66e0a1210c4f4d25fdfbe34aeb
If you're equipped with an Nvidia Graphics GPU, amplify your interpolation speed by installing TensorRT. Check out the SVP default guide for a smooth installation process:
https://www.svp-team.com/wiki/RIFE_AI_interpolation

Dive deeper into the anime enhancement journey. If the latest stable version doesn't quite satisfy your expectations, explore the cutting-edge experimental versions with the latest improvements. You can always revert to older models if needed.
Download latest RIFE from the bottom of the page here:
https://github.com/AmusementClub/vs-mlr … nal-models
Currently the latest one is this 2 days ago archive:
https://gyazo.com/637173b715eac98073928e66946ef256
But the fastest model seems to be rife_v4.6.onnx from rife_v2 folder of rife_v2_v4.7z :
https://github.com/AmusementClub/vs-mlr … e_v2_v4.7z

aloola wrote:

currently, the best quality that almost gets rid of the soap effect is models 4.12 and 4.13.
4.0->4.6: about the same quality and same performance
4.7->4.9: about the same quality and same performance, the performance cost +20% than 4.0->4.6
4.10->4.13: about the same quality and same performance, the performance cost +20% than 4.7->4.9
4.12lite, 4.13lite: performance between 4.7->4.9 and 4.10->4.13
my recommended models are: 4.6, 4.9 and 4.13

Then you copy the contents of the folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\"):
https://gyazo.com/b2de1180de4f68b82d333c9eee5e60f2
How the files should look if copied correctly:
https://gyazo.com/2f640fe54815c061392cd0760dc37624

How to upgrade TensorRT:
Go to this page and get latest vsmirt zip from https://github.com/AmusementClub/vs-mlrt/releases/ and install it according to guide below:

cws wrote:

Right, TensorRT 9.x is in "beta" and not officially released. Still, v13 was released when TensorRT 8.5 was the latest version, when there is a new release of TensorRT 8.x (which is 8.6.)

There may be fixes and enhancements in the latest v14 releases which is not in v13. If you're willing to help test, I would try downloading https://github.com/AmusementClub/vs-mlr … 4.test2.7z and unzipping

vstrt.dll

and the folder

vsmlrt-cuda

into

C:\Program Files (x86)\SVP 4\rife

Now, with a seamlessly upgraded RIFE interpolation AI model, enjoy the next level of anime animation.
Happy watching!

List of settings you can change to improve RIFE FPS for a smooth experience even on low end PC:
Use SVP's MPV video player instead of MPC-HC video player by installing it from SVP icon tray right click --> Utilities --> Additional programs and features... --> Add or remove components
Turn off Hardware Accelerated GPU Scheduling:
https://www.howtogeek.com/756935/how-to … indows-11/
Turn off GPU decoder in player:
If you're using SVP's MPC-HC you go to View->Options->Internal Filters->Video decoder->Hardware Acceleration->None
https://gyazo.com/93b27111fe9a43f1f6e0a49f46435e14
if you're using SVP's MPV then go to C:\Program Files (x86)\SVP 4\mpv64 and edit the file mpv.conf and edit this line:
hwdec=auto-copy change to #hwdec=auto-copy. Just remove the "#" if you want to use it again.
Enable Performance Boost for Nvidia TensorRT so the video starts faster:
https://gyazo.com/ab75720ef3674dc2c0ad390e5087221e
For the Soap Opera effect increase "Scene change threshold" to 100% (rife_sc in SVP Application settings) so it will always interpolate the source frames:
Example: https://gyazo.com/f969dd0efaf116e91713f8d2ecdfbb45
Add resize SVP Application parameter with a small resolution for SVP to downscale the video before interpolating without overwhelming your GPU if you want to play 4K resolution videos:
Possible values:
-1 (your current screen size)
-25601440 (2560x1440 pixels for 2K)
-19201080 (1920x1080 pixels for 1080p)
-12800720 (1280x720 pixels for 720p)
-10240576 (1024x576 pixels for constant 240 fps on a 4000 generation RTX GPU)
-06400480 (640x480 pixels for 480p)
Example: https://gyazo.com/cdd546a9c5e2efafaf9dd6d671fe00a8 and enable "Stretch to Window" in MPC-HC so you can see the resized video on whole screen https://gyazo.com/4e8b2532e2bd1cd9868f9d03e74dc2b6

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
RAGEdemon wrote:

How do I update to the latest version of RIFE for live conversion?

A simple list of instructions would be wonderful, thank you smile

The brilliant SVP developers made it extremely easy to install.
First you update SVP to latest version by right clicking it from task bar --> Utilities --> Additional programs and features... --> Update components --> Next >
https://gyazo.com/1702ec66e0a1210c4f4d25fdfbe34aeb
Then you download latest RIFE from the bottom of the page here:
https://github.com/AmusementClub/vs-mlr … nal-models
Currently the latest one is this 2 days ago archive:
https://gyazo.com/637173b715eac98073928e66946ef256
Then you copy the contents of the folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\"):
https://gyazo.com/6f2c1eff9a6a459fbd411faa11efbacb
How the files should look if copied correctly:
https://gyazo.com/2f640fe54815c061392cd0760dc37624
Please restart SVP. If done correctly, you should be able to select the new version from the AI model list.
Enjoy!

Amazing, Thank you!

+ An addition for some of us oldies - the RIFE TensorRT Engine does not show up until you go into the components and install the new RIFE/TensorRT Option. Then it will work!

Are there any options you would suggest? I see people have set GPU threads to 4 (default 2). And you are using the lite version, vs the standard version...

thanks again - very helpful. I think your post will be reverenced many times going into the future... smile

1,009 (edited by dawkinscm 19-11-2023 17:11:31)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RAGEdemon wrote:

I think your post will be reverenced many times going into the future... smile

Everything needed is already on this SVP manuals page https://www.svp-team.com/wiki/RIFE_AI_interpolation The extra stuff you've seen some of us doing here is interesting but not necessary for Rife. Especially since the SVP devs recently created a script that does most of the extra stuff for you.

The instructions you need are as follows:
1. Download and install SVP.
2. Follow the Rife AI manuals page.
3. Restart SVP.
4. Don't worry about the experimental stuff myself and others are doing because for most it's more likely to break your install than help it.

1,010

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?

1,011 (edited by dawkinscm 20-11-2023 16:23:54)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

odedg wrote:

What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?

Very little difference. So try both and let us know what you think.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

odedg wrote:

What is the difference between 4.9 and 4.12 lite versions ?
If I would guess lower picture quality better performance ?
And if so is it easier on CPU or GPU or Both ?

4.12 lite works a bit better on hardsubs and character borders, and a bit slower than 4.9, but 2080 Ti is still capable of 1080p24 x3 with Anime4K (to 2560x1440)

1,013

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

After trying 4.9 VS 4.12 Lite at least on performance aspect I can't see any difference at 4K on RTX4090 & i9 11900K. Same usage  & power draw on both.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

odedg wrote:

After trying 4.9 VS 4.12 Lite at least on performance aspect I can't see any difference at 4K on RTX4090 & i9 11900K. Same usage  & power draw on both.

Yep. There may or may not be differences between the two for Anime. But for live action I couldn't find a clear difference although 4.12 might be slightly better for fast motion.

1,015 (edited by Blackfyre 21-11-2023 15:49:54)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Will this driver scheduled for later today promising 5x the performance increase for TensorRT-LLM for 3000 and 4000 series GPU's have an impact on us using RIFE? I assume no.

Or will this improve performance for us? Or maybe something that needs a RIFE update to utilise version 0.6.0 benefits? Not sure. Just asking.


NVIDIA states a 5x performance boost with TensorRT-LLM v0.6.0 which will be available later this month

https://wccftech.com/nvidia-brings-up-t … x-30-gpus/

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Blackfyre wrote:

Will this driver scheduled for later today promising 5x the performance increase for TensorRT-LLM for 3000 and 4000 series GPU's have an impact on us using RIFE? I assume no.

Or will this improve performance for us? Or maybe something that needs a RIFE update to utilise version 0.6.0 benefits? Not sure. Just asking.


NVIDIA states a 5x performance boost with TensorRT-LLM v0.6.0 which will be available later this month

https://wccftech.com/nvidia-brings-up-t … x-30-gpus/

Chainik wrote:

how exactly "a library that leverages NVIDIA RTX architecture for accelerating large language models (LLMs)" is connected with us?

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Yep, thanks. As suspected. It won't be connected to SVP or RIFE performance lift.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

New version 4.13_Lite just got posted here: https://github.com/AmusementClub/vs-mlr … nal-models

Happy testing smile

1,019 (edited by dawkinscm 27-11-2023 10:55:40)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

donnieyeen wrote:

New version 4.13_Lite just got posted here: https://github.com/AmusementClub/vs-mlr … nal-models

Happy testing smile

Yeah I saw it earlier but I didn't bother to update because after testing it doesn't seem to be any different from 4.12lite or v9. I will wait for a full v4.13 or maybe 4.14 before commenting on here.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.

1,021 (edited by Xenocyde 28-11-2023 17:30:25)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

cemaydnlar wrote:

I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.

Sometimes the encoder source could cause problems too so maybe try to find the same anime from another encoder.

1,022

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

cemaydnlar wrote:

I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.

For animation, 4.12 or 4.13 is definitely better.
I've been using 4.12 for animation only.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

cemaydnlar wrote:

I am using rife 4.9 x3 with vsync and it creates a lot of artifacts on spy x family anime. Did you guys try this anime. I thought 4.9 should be better in the frame of artifacts but if i'm not mistaken it is the same as 4.6 with poor gpu performance.

For anime with a lot of hardcoded subtitles, try a model >= 4.10, even 4.12_lite is much better than 4.9.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

When you download new rife you get 2 folders. normal and V2, which to use?
Also which is better lite or normal rife?

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

@Chainik regarding "Scene Change Threshold", it's interesting how it works like artifact masking in the past. 15% provides the smoothest panning shots and the most artifacts. 6% shows the least artifacts, but less smoothness. 1% (set manually from all settings) has ZERO artifacts, but LEAST smoothness.

No dropped frames at all changing between percentages, but smoothness changes. Is there a way RIFE can improve smoothness while that percentage is lower? For example if we can achieve the smoothness of 15% at 3% it would be amazing, even better if we can achieve that smootheness at 1% to eliminate all artifacts, WOW that would be the dream.

Testing artifacts - One of the best scenes:

007 No Time To Die, around 3 minutes & 10 seconds, the sliding glass door with the masked man behind it walking towards it and opening it, huge difference can be noticed between 15%, 6%, and 1%.

Then when the masked man enters the room, the curtains in the background flickering in older versions of RIFE, such as 4.6, but solved in 4.9 for example and newer versions.

Then after 14 minutes, after the explosion, the action scene has a lot of panning shots that make it good for determining smoothness as well.