Welcome to our community

Be a part of something great, join today!

  • Hey all, just changed over the backend after 15 years I figured time to give it a bit of an update, its probably gonna be a bit weird for most of you and i am sure there is a few bugs to work out but it should kinda work the same as before... hopefully :)

redline to Qmater?

I don't think REDCODE works with G5.

I'm only getting 1 instance of REDline when exporting a script from REDrushes to Qmaster. I'm on a Mac pro with 8 cores and 8 instances setup. In Qmaster I add a new Shell... then set environment by loading the script file. I then submit it to my cluster. The cluster is connected to 10 rendering nodes. 8 on the Mac Pro and 2 on a G5. Only 1 instance on the Mac Pro are processing the job. Anyone else having a similar problem?

The Mac Pro is the Services and cluster controller. The G5 is services only. The managed check box is checked on both for "Shake and other shell command processing".

This is the script:

REDline -i /Users/Andrae/Desktop/RED\ DEMO\ REEL\ FOOTAGE/A001_06293F.RDM/A001_C001_0629Q9.RDC/A001_C001_0629Q9_001.R3D --outDir /Users/Andrae/Desktop/redline -w 0 -R 1 --useMeta --filter 5 --fit 1 --QTcodec 0 --resizeX 2048 --resizeY 1080 --noClobber
 
I don't think REDCODE works with G5.

Even when I take the G5 computer out of the equation I still only get one instance. This happens when I set up a quick cluster too.
 
This is the script:

REDline -i /Users/Andrae/Desktop/RED\ DEMO\ REEL\ FOOTAGE/A001_06293F.RDM/A001_C001_0629Q9.RDC/A001_C001_0629Q9_001.R3D --outDir /Users/Andrae/Desktop/redline -w 0 -R 1 --useMeta --filter 5 --fit 1 --QTcodec 0 --resizeX 2048 --resizeY 1080 --noClobber

You are not running qmaster with that command only redline.
In order to see how the command should look open Red Alert and mark the qmaster command option and save to command file
 
Hi Simon,

Now I'm ready with x4 8 core Mac Pros to do this, but I want to ask you few things.

The script you have posted, how should I save it as "redline.sh" as a file?

And after preparing this script then what do I have to do in REDRUSH to utilize this script?

Thank you very much in advance.

Kaku
 
You are not running qmaster with that command only redline.
In order to see how the command should look open Red Alert and mark the qmaster command option and save to command file

Thanks! Boy was I way off with this one. :-)
 
Hi Simon,

Now I'm ready with x4 8 core Mac Pros to do this, but I want to ask you few things.

The script you have posted, how should I save it as "redline.sh" as a file?

And after preparing this script then what do I have to do in REDRUSH to utilize this script?

Thank you very much in advance.

Kaku

Just use text editor on the mac or any PC and save it as a .sh file. make sure you edit the name of the cluster to your cluster.
 
I'm only getting 1 instance of REDline when exporting a script from REDrushes to Qmaster. I'm on a Mac pro with 8 cores and 8 instances setup. In Qmaster I add a new Shell... then set environment by loading the script file. I then submit it to my cluster. The cluster is connected to 10 rendering nodes. 8 on the Mac Pro and 2 on a G5. Only 1 instance on the Mac Pro are processing the job. Anyone else having a similar problem?

The Mac Pro is the Services and cluster controller. The G5 is services only. The managed check box is checked on both for "Shake and other shell command processing".

This is the script:

REDline -i /Users/Andrae/Desktop/RED\ DEMO\ REEL\ FOOTAGE/A001_06293F.RDM/A001_C001_0629Q9.RDC/A001_C001_0629Q9_001.R3D --outDir /Users/Andrae/Desktop/redline -w 0 -R 1 --useMeta --filter 5 --fit 1 --QTcodec 0 --resizeX 2048 --resizeY 1080 --noClobber

If you only send one file to it it will only use one node I am afraid regardless of how many cores you have. It does not spread it over each core unless you set the Qmaster to run 1 instance only on the machine. But then you can only convert one file at a time. the advantage of having 8 instances is that you can submit 8 renders at the same time, this can have overheads on you machine though if it is also running the redline commands and acting as the render manager.
 
Just use text editor on the mac or any PC and save it as a .sh file. make sure you edit the name of the cluster to your cluster.

To use Redrushes as long as you have the application folder set up as a watched folder (look at previous post about this) then all you do is just save out a script from redsushes to the watched folder and the script will do the rest.
 
Simon, sorry it's a unix questions, but I switched in the terminal to logon as root then typed the command to run the redline.sh, but it comes back saying permission denied.

It looks like this.

dhcp07:~ root# /Applications/redline/redline.sh > /dev/null 2&1
[1] 4758
-sh: /Applications/redline/redline.sh: Permission denied
-sh: 1: command not found
[1]+ Done(126) /Applications/redline/redline.sh 2 > /dev/null

What do you think I'm doing wrong?
 
Simon, sorry it's a unix questions, but I switched in the terminal to logon as root then typed the command to run the redline.sh, but it comes back saying permission denied.

It looks like this.

dhcp07:~ root# /Applications/redline/redline.sh > /dev/null 2&1
[1] 4758
-sh: /Applications/redline/redline.sh: Permission denied
-sh: 1: command not found
[1]+ Done(126) /Applications/redline/redline.sh 2 > /dev/null

What do you think I'm doing wrong?

Not sure what the issue is TBH, we run the script as the systems regular user I do not change the login in a shell or anything as it just runs in the background all the time. Have you tried a chmod command on the file to give full access to it. If not chmod -R 777 /Applications/redline.redline.sh and see if that works.
 
Hello Simon,

I think it was the access previl. and now when I type in the /dev/null 2$1 command it doesn't go to error, instead, just comes back with another line.

Then I go to REDrush and added some clips, then export script in the redline folder as what ever the name (does it have to be called certain name?), then see if it's running, but it doesn't seem to be.

I made sure changing the cluster name. But I'm not so certain about the R3D location you were mentioning that is important, I guess I place the R3D in a volume that is on the control computer, make that shared (maybe I have to mount it on other computers?).

Thank you very much for your help.

Kaku
 
Hello Simon,

I think it was the access previl. and now when I type in the /dev/null 2$1 command it doesn't go to error, instead, just comes back with another line.

Then I go to REDrush and added some clips, then export script in the redline folder as what ever the name (does it have to be called certain name?), then see if it's running, but it doesn't seem to be.

I made sure changing the cluster name. But I'm not so certain about the R3D location you were mentioning that is important, I guess I place the R3D in a volume that is on the control computer, make that shared (maybe I have to mount it on other computers?).

Thank you very much for your help.

Kaku

You can call the script anything you like we just use the project name. Is it actually being sent to Qmaster or is nothing happening at all? In the redline directory make a folder called completed ( I forgot to add that in previous post) as the script moves the original Redrushes one to that folder when processed so it does not do it again.

With regards to your footage, it all needs to be located on a server that all the render nodes can access. You then need to mount that location on every render node. it must be mounted in exactly the same way or not all the nodes will access the footage. The same goes for the location you want to render to. Also make sure Redline is installed on every node, not sure this is entirely necessary but that is how I have it set up.

In Redrushes you then load up the R3D from the same server location and then set your render settings and export the script.

Hope this helps.
 
Simon,

Thank you so much for helping out.
I will try everything you mentioned and let you know.

Let me know if you need anything to do with Japan or Japanese.

Best,

Kaku
 
Will do and good luck.

Simon,

I think I did everything correct but it's not kicking in yet.
Do I need to create "redline" folder in every node?

Since I have the raid in one of the node, the main machine is accessing the R3D location and the output location directly, so that may make it go wrong?

Also in the script, I did change the qmaster name but I notice it says something about xserve following the qmaster name, is that something related to your setting and maybe I should change?

Sorry I have many questions.

Best,

Kaku
 
Simon,

I think I did everything correct but it's not kicking in yet.
Do I need to create "redline" folder in every node?

Since I have the raid in one of the node, the main machine is accessing the R3D location and the output location directly, so that may make it go wrong?

Also in the script, I did change the qmaster name but I notice it says something about xserve following the qmaster name, is that something related to your setting and maybe I should change?

Sorry I have many questions.

Best,


Kaku

No you only need the redline folder with the script in on the machine you are using as ingest. Are you running the script to watch the folder in crontab. Yes get rid of the xserve in the script that is my setting and maybe the issue.
 
Simon,

What does <xserve plf> stands for? Will I have to type in something else instead?
 
Simon,

What does <xserve plf> stands for? Will I have to type in something else instead?

Its the name of my cluster for Qmaster. You need to change it to the name of your cluster. I suggest you read up on qmaster and look at you Qmaster setup and see if you have set it up properly.

You can enter a unix command via the interface to see if its working ok. Just copy one of the Redline commands out of the Redrushes script and enter that using the Qmaster application using unix commands.
 
Back
Top