Premiere CC Load/Save Times Too Long + R3D Files Take Too Long to Load

[Luke Humphrey]

I have a Premiere project (latest updates) with maybe 50-70 6k Dragon R3D files. I also have maybe 40 time-lapse sequences (JPG with 500+ images each).

I have several problems that are getting in the way of the creative process here:

1. Opening the APP project takes a long time, several minutes. Wouldn't be a huge deal if Premiere didn't crash so often.
2. Saving takes several minutes. This really disrupts my editing flow if I save every 5-10 min. If I don't save I risk data loss upon crash (happens frequently enough).
3. Actually loading the R3D files takes a long time. Meaning I'll see them in the timeline after Premiere has "loaded" everything, but I have to wait up to 5 minutes to get them to actually be playable.

I've done a couple things to try and isolate the problem:
1. I started a new project and just added the time-lapse stuff. Save and load is pretty quick with just these. Once I add the R3Ds it seems to slow down significantly.
2. I've run sysinternal "Process Monitor" to see what's going on during these long saves/opens. Here's an example of what happens on open (this is a quick open with a paired down project, usually it's much worse):
--For about 94% of the open time, the project file (just the project file) is being read thousands of times
--For 3% of the time other APP program files are being loaded + each individual JPEG in the time-lapse sequences
--For only 2% seconds the R3D files are loaded
--For the 1% of the time the media cache files are loaded

Saving is 99% thousands of writes to a temporary project file. I don't understand why it's not one write after everything as been sorted in memory. I also don't understand why only the diffs from my last save are processed on subsequent saves, which should take milliseconds (e.g. a small change in an edit, which is probably represented by moving/changing a couple XML nodes/values).

Sample of what happens when opening file-wise. It's over 90% small reads on the project file.

Hardware: i7-5820K 3.3Ghz, 64GB DDR4 2133, Nvidia GTX 980, RAID array SATA w/900 MB RW or RAID array SSD with similar speeds.

Thoughts/insight? I really can't wait this long to save - I end up spending 10 minutes editing, 3-5+ saving. It's very hard to get into a flow. Also I don't quite understand why the r3D files take so long to load in the timeline before I can play them after Premiere has said "everything is loaded". And then if I don't continuously work with them, the loading process starts again and sometimes APP hangs.

Thanks,

Luke

 

[Mike Harrington]

Running antivirus?

Had similar problem with a 3d app recently, process monitor showed it wasting extreme cycles attempting to open.

Removal of kaspersky (complete removal) was the only solution

Just a shot in the dark....

 

[T_Freundlich]

And a couple of more quick shots -

- Are you running any Warp Stabilizer on the footage? I've found that stabilizing long 4K+ clips can jam up the project with huge amounts of data, taking forever to save.

- Sometimes I've run into frustratingly long R3D footage load times due to the auto-generation of the audio peak files for the footage. Disabling this from the preferences helps in this particular instance.

 

[Luke Humphrey]

RE: Mike: No other processes (virus or otherwise) are showing up as consuming CPU/memory.
RE: T_Freundlich: I have indeed warp stabilized all red clips. Unfortunately I need to do this, so I suppose there's nothing I can do in this case?
Audio peak files? I'm not familiar with these - is this the waveform viz for audio? If yes these R3D clips have no audio.

 

[Mike Harrington]

RE: Mike: No other processes (virus or otherwise) are showing up as consuming CPU/memory.
RE: T_Freundlich: I have indeed warp stabilized all red clips. Unfortunately I need to do this, so I suppose there's nothing I can do in this case?
Audio peak files? I'm not familiar with these - is this the waveform viz for audio? If yes these R3D clips have no audio.

not saying the anti virus would consume memory.....but in my case re my post it was causing extreme file loading times & large cpu cycles in the 3d process...removing it fixed the issue

 

[Luke Humphrey]

Thanks for the suggestion Mike - yeah I'm not running any special anti-virus software and nothing else is really showing up as consuming CPU in the task manager.

 

[T_Freundlich]

Yep, the audio peak files mean the waveform displayed with the clip in the timeline, but that's clearly not the issue here.

I would explore the stabilization just to potentially isolate the problem - try saving a new version of the project for testing, delete all the Warp Stabilizer effects and see if it makes a difference?