With upcoming changes to data protection and privacy laws in Europe coming into effect soon, we thought this would be a good time to remind everyone that we do have a privacy policy.
This applies to all users and visitors world-wide.

We have made a few changes to the language to make it clearer in relation to this new regulation but fundamentally, the terms and your rights are unchanged.

If you have any questions about this, please feel free to ask in the General Forum

Handbrake (linux) with OpenMosix Cluster

General discussion of HandBrake, Video and/or audio transcoding, trends etc.
Forum rules
Please be aware, this forum is not for support or help related to HandBrake. Please keep such discussions to the Community Support forum sections.
Post Reply
Posts: 5
Joined: Fri Apr 20, 2007 9:01 am

Handbrake (linux) with OpenMosix Cluster

Post by jamesdo » Wed May 23, 2007 12:36 pm


I search some solution to support a lots of encoding process in a really short period of time, with as less administration as possible.

The CLI Handbrake will be a realy good solution. My experience with it show that's a nice solution with good quality with few bug (this f*cking sound drop sometimes make me crazy but ...).

So my question is can Handbrake support OpenMOSIX cluster (process migration between a cluster of computer) ?

Has I know OpenMOSIX, it works by moving processes from a heavily loaded machine to a more lightly loaded machine. Handbrake use only one process, but many thread, has I understand ?

Thanks for your help,

Veteran User
Posts: 2888
Joined: Tue Apr 18, 2006 10:24 pm

Post by rhester » Wed May 23, 2007 2:48 pm

Best recommendation I can make: try it.


Posts: 42
Joined: Mon Apr 09, 2007 3:39 am

Post by tubbyman » Thu May 24, 2007 1:49 am

I am doing this on a loose heterogeneous cluster of linux boxes and osx boxes, using perl and the CLI versions of handbrake/mediafork. It works rather well, and is surprisingly easy to do if you know a scripting language. I've also done it with XGrid as a grid controller.

Here's what I did:
1) Put all of your VIDEO_TS folders on a networked drive(s).
2) Put the cli binary in the same location on each machine.
3) write a script to find all of the titles and all of the VIDEO_TS folders on the drive(s)
4) write a script to control the job distribution (this could be as easy as a loop with ssh/rsh -e calls).

If you are using OpenMosix, I assume that you are familiar with some scripting language, so you shouldn't have any problems.

I have a script on this site somewhere that finds VIDEO_TS and titles. Since I process an entire hard drive at once on each machine (which takes days), I didn't see much need to get fancy with queuing, just "ssh/rsh -e mediaforker.pl /Volumes/Drive#" from the controller to all of the machines.

My script processing unit is a title, but if you wanted to process in smaller chunks and send them out to different machines, it could be easily modified to process by chapter (maybe even blocks or chunks?), but then you would have to write something to reassemble the chapters back into a movie.

Here is the post with the scripts:


I think some of the developers may have recently written some useful scripts, as well, but I haven't used them yet.

Posts: 5
Joined: Fri Apr 20, 2007 9:01 am

Post by jamesdo » Thu May 24, 2007 10:07 am

My idea is to launch process only on the master machine and let OpenMOSIX migrate te process to other node.

Each node boot on a custom Dyne Bolic Live CD. I need to build this CD first with all the needed dependencies.

To deal with handbrake the idea is to use the CLI with -C 1 and launch one process per CPU (core) avaible on the cluster. The problem is to report the to global fps of the cluster and monitore all the process status from one console. Maybe some pipe with awk and grep can solve those issues. I need to be able to kill any process on the cluster if I suspect an audio drop, or any other problems.

I use OpenMOSIX to render some PureData calculation and blender rendering with success.

The big advantage of OpenMOSIX is the flexibility on the number of node. When I go home, I can add my portable computer to the cluster, by simply boot it on a Live CD (Dyne Bolic) and my clusteris extented automaticaly. So i can use any computer( girlfriend's computer, friend's computer ;-) )

And OpenMOSIX balance the load really well on the different node.

Post Reply