Topic: memory leak with new install

here's the log:

16:25:40.041; Start: SVPMgr 3.1.5 (931) starts...
16:25:40.051; AppDataPath: C:\ProgramData (ANSI)
16:25:40.051; Start: read settings file settings.ini
16:25:40.051; Start: load language file - English. Duration: 40 ms
16:25:40.091; Start: check launched instance of SVP-manager
16:25:40.091; Start: check Avisynth installed. Duration: 80 ms
16:25:40.171; Start: clear Logs folder
16:25:40.171; Start: performance graphs prepare. Duration: 10 ms
16:25:40.181; Start: SVPMgr folders prepare. Duration: 10 ms
16:25:40.191; Start: read settings file SVPMgr.ini
16:25:40.191; Start: GPUs settings detection. Duration: 120 ms
16:25:40.311; Start: detected graphics (OpenCL) adapters:
11. GeForce GTX TITAN (2035)
12. GeForce GTX TITAN (2111)
13. GeForce GTX TITAN (1964)
16:25:40.311; Start: monitors settings detection. Duration: 590 ms
16:25:40.901; Start: detected monitor: 1920 x 1080 @ 119.98
16:25:40.901; Start: disable LNG-file write when UAC enabled
16:25:40.901; Start: change SVP-manager priority
16:25:40.901; Start: register hotkeys. Duration: 110 ms
16:25:41.011; Start: get versions of modules used
ffdshow.ax/avisynth.dll: 1.3.4515.0/2.5.8.6
svpflow1/2.dll: 1.3.4.0/1.5.1.0
svpflow_cpu/gpu.dll: 1.7.2.0/1.7.9.0
16:25:41.011; Start: refresh autostart state in registry
16:25:41.011; Start: some more work with registry. Duration: 10 ms
16:25:41.021; Start: create menu. Duration: 10 ms
16:25:41.031; Start: update settings file settings.ini. Duration: 20 ms
16:25:41.051; Start: update monitor settings
16:25:41.051; Start: prepare "About the program" window. Duration: 30 ms
16:25:41.081; Start: enable ffdShow waiting mode. Duration: 10 ms
16:25:41.091; Start: prepare to work is complete
16:25:41.091; RefreshSVP
16:25:41.091; ===== Waiting for ffdshow video

16:26:22.235; RefreshSVP. Duration: 10 ms
16:26:22.245; ===== Waiting for ffdshow video

16:26:29.905; RefreshSVP. Duration: 10 ms
16:26:29.915; ===== Waiting for ffdshow video

16:26:30.975; RefreshSVP. Duration: 10 ms
16:26:30.985; ===== Waiting for ffdshow video

16:26:31.465; RefreshSVP
16:26:31.465; ===== Waiting for ffdshow video

16:26:31.935; RefreshSVP. Duration: 10 ms
16:26:31.945; ===== Waiting for ffdshow video

16:26:32.426; RefreshSVP
16:26:32.426; ===== Waiting for ffdshow video

16:26:32.896; RefreshSVP. Duration: 10 ms
16:26:32.906; ===== Waiting for ffdshow video

16:27:59.401; ===== Detected playback with ffdShow. AppName: mpc-hc.exe PID: 404. Duration: 6 ms
16:27:59.407; GetDimensionAndFPS_fromOSD start. Duration: 98 ms
16:27:59.505; GetDimensionAndFPS_fromOSD result: 1920x1080 23.999 1/1
16:27:59.524; T1T: begin
16:27:59.527; RefreshSVP
16:27:59.530; T1T: GetAllMediaParams. Duration: 18 ms
16:27:59.548; ### CorrectStereoModeByAppAndFilename: big_buck_bunny_1080p_stereo.avi
16:27:59.551; T1T: SettingsPrepare. Duration: 18 ms
16:27:59.569; T1T: Preparing smooth playback...
16:27:59.575; T1T: WriteAllMediaParamsToIni
16:27:59.577; SVPMgr: main "C:\ProgramData\SVP 3.1\" 1920 1080 23.999 1920 1080 5 1. Duration: 232 ms
16:27:59.809; ===== Playback
23.999 * (5 : 1) = 119.995 fps
16:27:59.812; SetPriorityPlayer: 2. Duration: 1204 ms
16:28:01.016; this is changing FalseVFR_Dwn. ffdShow-framerate: 18.279
16:28:01.819; Error: Warning: there's a memory leak in the video player: 719 MB
To prevent the closing of the player due to lack of memory a script restarted improve smoothness.. Duration: 133 ms
16:28:01.952; this is changing FalseVFR_Dwn. ffdShow-framerate: 16.689
16:28:02.989; this is changing FalseVFR_Up. ffdShow-framerate: 22.561
16:28:04.251; this is changing FalseVFR_Up. ffdShow-framerate: 23.831
16:28:05.193; this is changing FalseVFR_Up. ffdShow-framerate: 23.999
16:28:05.195; express clear interval
16:28:05.197; stabilized ffdShow-framerate: 23.999 fps. SVP Index:0.00/0.00
16:28:09.595; RefreshSVP
16:28:09.599; ===== Waiting for ffdshow video

16:28:15.720; at start:0 at end:0 stable
16:28:43.112; ===== Detected playback with ffdShow. AppName: mpc-hc.exe PID: 12940
16:28:43.116; GetDimensionAndFPS_fromOSD start. Duration: 61 ms
16:28:43.177; GetDimensionAndFPS_fromOSD result: 1920x1080 23.999 1/1
16:28:43.196; T1T: begin
16:28:43.197; T1T: GetAllMediaParams. Duration: 20 ms
16:28:43.217; ### CorrectStereoModeByAppAndFilename: big_buck_bunny_1080p_stereo.avi
16:28:43.219; T1T: SettingsPrepare. Duration: 14 ms
16:28:43.233; T1T: Preparing smooth playback...
16:28:43.236; T1T: WriteAllMediaParamsToIni
16:28:43.239; SVPMgr: main "C:\ProgramData\SVP 3.1\" 1920 1080 23.999 1920 1080 5 1. Duration: 151 ms
16:28:43.390; ===== Playback
23.999 * (5 : 1) = 119.995 fps
16:28:43.393; SetPriorityPlayer: 2. Duration: 2548 ms
16:28:45.941; Error: Warning: there's a memory leak in the video player: 1592 MB
To prevent the closing of the player due to lack of memory a script restarted improve smoothness.. Duration: 16493 ms
16:29:02.434; RefreshSVP. Duration: 10 ms
16:29:02.444; ===== Waiting for ffdshow video

16:29:06.399; at start:0 at end:0 stable

Re: memory leak with new install

Try SVP Manager memory leak fix modification: SVPMgr315.1016_MemoryLeak_mod.zip

Fixed free memory detection to make possible use of 4GB RAM by player

- download
- unzip to SVP folder with file replacement
- launch SVP Manager

Post's attachments

SVPMgr315.1016_MemoryLeak_mod.zip 367.39 kb, 557 downloads since 2014-01-12 

Re: memory leak with new install

same problem...what other information can I provide:
log:

22:43:31.606; Start: SVPMgr 3.1.5 (1016) starts...
22:43:31.608; AppDataPath: C:\ProgramData (ANSI)
22:43:31.610; Start: read settings file settings.ini
22:43:31.611; Start: load language file - English. Duration: 45 ms
22:43:31.656; Start: check launched instance of SVP-manager
22:43:31.659; Start: check Avisynth installed. Duration: 2298 ms
22:43:33.957; Start: clear Logs folder
22:43:33.961; Start: performance graphs prepare
22:43:33.963; Start: SVPMgr folders prepare. Duration: 7 ms
22:43:33.970; Start: read settings file SVPMgr.ini
22:43:33.973; Start: GPUs settings detection. Duration: 26 ms
22:43:33.999; Start: detected graphics (OpenCL) adapters:
11. GeForce GTX TITAN (1996)
12. GeForce GTX TITAN (1992)
13. GeForce GTX TITAN (1936)
22:43:34.000; Start: monitors settings detection
22:43:34.002; Start: detected monitor: #00010001 1920 x 1080 @ 120
22:43:34.004; Start: disable LNG-file write when UAC enabled
22:43:34.005; Start: change SVP-manager priority
22:43:34.007; Start: register hotkeys
22:43:34.012; Start: get versions of modules used
ffdshow.ax/avisynth.dll: 1.3.4515.0/2.5.8.6
svpflow1/2.dll: 1.3.4.0/1.5.1.0
svpflow_cpu/gpu.dll: 1.7.2.0/1.7.9.0
22:43:34.014; Start: refresh autostart state in registry
22:43:34.016; Start: some more work with registry
22:43:34.019; Start: create menu. Duration: 8 ms
22:43:34.027; Start: update settings file settings.ini. Duration: 15 ms
22:43:34.042; Start: prepare "About the program" window. Duration: 9 ms
22:43:34.051; Start: enable ffdShow waiting mode
22:43:34.052; Start: prepare to work is complete
22:43:34.055; RefreshSVP
22:43:34.058; ===== Waiting for ffdshow video

8:17:23.707; ===== Detected playback with ffdShow. AppName: mpc-hc.exe PID: 9172. Duration: 13 ms
8:17:23.720; GetDimensionAndFPS_fromOSD start. Duration: 78 ms
8:17:23.798; GetDimensionAndFPS_fromOSD result: 1920x1072 23.975 1/1
8:17:23.804; T1T: begin. Duration: 586 ms
8:17:24.390; screen settings refining: #00010001 1920 x 1080 @ 120.103
8:17:24.393; T1T: GetAllMediaParams
8:17:24.396; ### CorrectStereoModeByAppAndFilename: h264_1080p_hp_4.1_40mbps_birds.mkv
8:17:24.398; T1T: SettingsPrepare. Duration: 7 ms
8:17:24.405; T1T: Preparing smooth playback...
8:17:24.409; T1T: WriteAllMediaParamsToIni
8:17:24.412; SVPMgr: main "C:\ProgramData\SVP 3.1\" 1920 1080 23.975 1920 1072 526 105. Duration: 148 ms
8:17:24.560; ===== Playback
23.975 * (526 : 105) = 120.103 fps
8:17:24.561; SetPriorityPlayer: 2. Duration: 1060 ms
8:17:25.621; Error: Warning: there's a memory leak in the video player: 757 MB
To prevent the closing of the player due to lack of memory a script restarted improve smoothness.. Duration: 10813 ms
8:17:36.434; RefreshSVP
8:17:36.438; ===== Waiting for ffdshow video

8:17:40.733; at start:0 at end:0 stable

Re: memory leak with new install

gillecaluim

16:28:01.819; Error: Warning: there's a memory leak in the video player: 719 MB

16:28:45.941; Error: Warning: there's a memory leak in the video player: 1592 MB

8:17:25.621; Error: Warning: there's a memory leak in the video player: 757 MB

It is strange. SVP must allow much bigger memory use by player if you have 4+ GB RAM installed.

See Performance graphs window and amount of available memory for player.

http://www.svp-team.com/forum/misc.php?item=2981

Please show your AVS-script: SVP tray menu - Information - Last used AVS Script

Post's attachments

performance_graphs_3965MB_free.png, 11.72 kb, 539 x 332
performance_graphs_3965MB_free.png 11.72 kb, 409 downloads since 2014-01-13 

Re: memory leak with new install

Is there commercial or consulting option available?

Re: memory leak with new install

gillecaluim
I can connect to your supercomputer via teamviewer. Send me your ID and pass by e-mail.

Re: memory leak with new install

here's the last AVS Script
# This script was generated by SmoothVideo Project (SVP) Manager.
# Check http://www.svp-team.com for more details.

SetMemoryMax(1024)

global svp_scheduler=true
global threads=58
global svp_cache_fwd=threads+2

LoadPlugin("C:\Program Files (x86)\SVP\plugins\svpflow1.dll")
LoadPlugin("C:\Program Files (x86)\SVP\plugins\svpflow2.dll")

SetMTMode(3,threads)
ffdShow_source()
SetMTMode(2)

global crop_params=""
global resize_string="BicubicResize(1920, 1080, b=0, c=0.75)"
global super_params="{scale:{up:0},gpu:1,rc:true}"
global analyse_params="{main:{search:{coarse:{distance:-10,bad:{sad:2000}}}},refine:[{thsad:65000}]}"
global smoothfps_params="{gpuid:11,rate:{num:421,den:84},algo:13,scene:{}}"

global demo_mode=0
stereo_type=0
stereo_left_selection=""
stereo_right_selection=""

########## BEGIN OF MSMoothFps.avs ##########
# This file is a part of SmoothVideo Project (SVP) 3.1.4
# This is NOT the full AVS script, all used variables are defined via
# JavaScript code that generates the full script text.

function interpolate(clip src)
{
    input = crop_params=="" ? src : eval("src.crop("+crop_params+")")
    input = resize_string=="" ? input : eval("input."+resize_string)

    super=SVSuper(input, super_params)
    vectors=SVAnalyse(super, analyse_params, src=input)
    smooth=SVSmoothFps(input, super, vectors, smoothfps_params, mt=threads, url="www.svp-team.com")

    return demo_mode==0 ? smooth : demo(input,smooth)
}

input=last

    stereo_type==0 ? eval(""" interpolate(input)
""") :     stereo_type==1 || stereo_type==3 ? eval("""
        lf = interpolate(input.crop(0,0,input.width/2,0))"""+stereo_left_selection+"""
        rf = interpolate(input.crop(input.width/2,0,0,0))"""+stereo_right_selection+"""
        StackHorizontal(lf, rf)
""") :     stereo_type==2 || stereo_type==4  ? Eval("""
        lf = interpolate(input.crop(0,0,0,input.height/2))"""+stereo_left_selection+"""
        rf = interpolate(input.crop(0,input.height/2,0,0))"""+stereo_right_selection+"""
        StackVertical(lf, rf)""") : input

########### END OF MSMoothFps.avs ###########
distributor()

Re: memory leak with new install

installed teamviewer
what is you email to send id/pwd?

Re: memory leak with new install

gillecaluim
global threads=58
Big number. It can lead to memory leaks error.

Click on MAG79 - Send message via forum

Re: memory leak with new install

sent info.
changed processing threads from auto to 10 and still get memory leak

Re: memory leak with new install

gillecaluim
Is there commercial or consulting option available?

it's a freeware project big_smile
still MAG79 is always to the rescue wink

Re: memory leak with new install

See funny picture there.
The solution will be soon.
SVP was designed not for such supercomputers as gillecaluim's one. wink

Re: memory leak with new install

gillecaluim
Try SVP Manager much threads fix modification: SVPMgr315.1018_MuchThreads_mod.zip

- added CPU identification;
- fixed work with huge number of threads

- download
- unzip to SVP folder with files replacement
- launch SVP Manager

21:57:37.065; Start: SVPMgr 3.1.5 (1018) starts...
21:57:37.065; AppDataPath: C:\ProgramData (ANSI)
21:57:37.065; Start: read settings file settings.ini
21:57:37.065; Start: load language file - English. Duration: 28 ms
21:57:37.093; Start: check launched instance of SVP-manager
21:57:37.093; Start: check Avisynth installed
21:57:37.093; Start: clear Logs folder
21:57:37.094; Start: SVPMgr folders prepare
21:57:37.099; Start: read settings file SVPMgr.ini
21:57:37.100; Start: performance graphs prepare
21:57:37.100; Start: CPU and threads count detection
CPU: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz
Threads: 4

Post's attachments

SVPMgr315.1018_MuchThreads_mod.zip 368.09 kb, 453 downloads since 2014-01-15 

Re: memory leak with new install

Here's my startup log:

10:18:22.752; Start: SVPMgr 3.1.5 (1018) starts...
10:18:22.752; AppDataPath: C:\ProgramData (ANSI)
10:18:22.752; Start: read settings file settings.ini
10:18:22.752; Start: load language file - English. Duration: 40 ms
10:18:22.792; Start: check launched instance of SVP-manager
10:18:22.792; Start: check Avisynth installed. Duration: 100 ms
10:18:22.892; Start: clear Logs folder. Duration: 10 ms
10:18:22.902; Start: SVPMgr folders prepare. Duration: 10 ms
10:18:22.912; Start: read settings file SVPMgr.ini. Duration: 10 ms
10:18:22.922; Start: performance graphs prepare
10:18:22.922; Start: CPU and threads count detection
CPU: Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz
Threads: 32
10:18:22.922; Start: GPUs settings detection. Duration: 30 ms
10:18:22.952; Start: detected graphics (OpenCL) adapters:
11. GeForce GTX TITAN (2051)
12. GeForce GTX TITAN (2031)
13. GeForce GTX TITAN (1948)
10:18:22.952; Start: monitors settings detection
10:18:22.952; Start: detected monitor: #00010001 1920 x 1080 @ 120
10:18:22.952; Start: disable LNG-file write when UAC enabled
10:18:22.952; Start: change SVP-manager priority
10:18:22.952; Start: register hotkeys. Duration: 120 ms
10:18:23.072; Start: get versions of modules used
ffdshow.ax/avisynth.dll: 1.3.4515.0/2.5.8.6
svpflow1/2.dll: 1.3.4.0/1.5.1.0
svpflow_cpu/gpu.dll: 1.7.2.0/1.7.9.0. Duration: 10 ms
10:18:23.082; Start: refresh autostart state in registry
10:18:23.082; Start: some more work with registry
10:18:23.082; Start: create menu. Duration: 20 ms
10:18:23.102; Start: update settings file settings.ini. Duration: 20 ms
10:18:23.122; Start: prepare "About the program" window. Duration: 10 ms
10:18:23.132; Updates: check for updates. Request sended
10:18:23.262; Start: enable ffdShow waiting mode
10:18:23.262; Start: prepare to work is complete
10:18:23.272; RefreshSVP
10:18:23.272; ===== Waiting for ffdshow video

10:18:33.953; Updates: connection closed

so, it looks like you've refactored to permit up to 32 threads inside svp even if there are more cores & threads possible?

Re: memory leak with new install

it works.  Had to set threads to 30 instead of auto.  Will now convert stereoscopic 1080p@30 to 1080p@60.  But a few weird things are showing up.  I have evga precision running to monitor and the osd of framerate while in full screen
1.  when I play a stereoscopic 720p film, the evga osd shows 120hz..... big_smile
2.  when I play a stereoscopic 1080p film, the evga osd initially shows around 40hz and then after about 10secs gradually gets up to 120hz and stays there.  This is a repeatable phenomenon.  What's weird is that the performance graphs show 120hz all the way through hmm

Re: memory leak with new install

grrr....now I'm getting svp performance too low when playing the same 1080p video....how is that even possible?  I haven't changed anything with the profiles

Re: memory leak with new install

gillecaluim
Threads: 32

Hm. It is funny big_smile
Windows core function GetSystemInfo (kernel32 lib) returns that value of NumberOfProcessors parameter.
SYSTEM_INFO supports up to 32 processors (threads):

dwActiveProcessorMask
A mask representing the set of processors configured into the system. Bit 0 is processor 0; bit 31 is processor 31.

So, your supercomputer may function not at full power of 40 threads because it not fully supported by some windows core libraries for 32bit applications. roll

Do you trust to 32bit measurment utils like EVGA Precision after that? I think you need to trust to your eyes better then all other software on your supercomputer wink
To do that run Tearing test form SVP tray menu and look to the screen. You will see 120fps and can differ it from 40 fps. cool

Re: memory leak with new install

I mis-stated my earlier results....I meant to say that the 720p stereoscopic evga fps stated 60hz which for svp would be 120hz since it's stereo.  The 1080p film still can't run at the 120hz...get the svp index =0.77.  CPU core @ 21% Memory @ 2497MB.  I can tweak the profile downward to get it running but what puzzles me is why I'd need to with this much computing power

Re: memory leak with new install

gillecaluim
I can tweak the profile downward

Can you?  hmm

What I saw is Stereoscopic has real problems with rendering full FHD stereo pair at 60 Hz.

20 (edited by gillecaluim 17-01-2014 04:27:20)

Re: memory leak with new install

hmmm....you're probably right.  I'll play around with the settings keeping the framerate fixed and see if I can make it go.  I thought Mag had stereoscopic FHD@60 running?  And I'll download a 1080p@60hz stereoscopic video to test the player

Update:
can play Big Buck Bunny 1080p @ 60Hz with stereoscopic player.....
so the bottle neck isn't the player.

Re: memory leak with new install

I can tweak the settings down to obtain a 1080p@60 stereoscopic output.  I think the real issue is how well avs/svp can scale with adding processors vs processor speed.  You're still limited by the slowest thread and some computations may not be amenable to parallel computing.

Re: memory leak with new install

the only possible bottleneck is GPU acceleration
here's the place where all 40+ threads must wait for one thread running on GPU

try to turn it off

Re: memory leak with new install

has there been any thought of creating 64bit svp.  I've seen a couple of 64bit versions of ffdshow and avisynth and claims of improved speed with some of the other plugins.