Performance Comparison between Windows, Mac and Linux?

General questions or discussion about HandBrake, Video and/or audio transcoding, trends etc.
Post Reply
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

Has anyone previously conducted a performance comparison of Handbrake on the same hardware to evaluate which platform offers the highest performance under Handbrake?

If not, over the next few days I will look to conduct one.
User avatar
s55
HandBrake Team
Posts: 10360
Joined: Sun Dec 24, 2006 1:05 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by s55 »

Any difference is within margin of error. (same settings, version, hardware etc)

32 -> 64bit hoever gives around 10% boost in encode framerate.

Only thing to watch out for, is certain older versions of the linux kernel have a scheduler bug which can have a pretty heavy impact on performance) (Think it was pre 2.6.32 has this problem) http://x264dev.multimedia.cx/archives/185
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

I have finished my testing.

As you stated, performance between Mac and Linux was identical, sitting at an average FPS of 334 when using the built-in Apple Universal preset in conjunction with the same video files.
Tested with Eureka s01e01, Battlestar Galactica s01e01, The Invisible, and The Killer Inside Me, all pre-ripped from DVD to SSD prior to processing.

However, under Windows, each test sat at an average of 171 FPS with the same video files on the same hardware.

The machine in question is:

Custom Build
Motherboard: Gigabyte ga-790xta-ud4
Processor: AMD Phenom II 1090T (Black) - 4.1 GHz (Overclocked)
Heat Sync: Corsair HT-70 Liquid Cooling
Memory: 16GB DDR3 1600 MHz (Dual Channel)
Disk: Crucial RealSSD 300 - 256GB connected via SATA3
Graphics: AMD Radeon HD 6870
BDRW: LG iHES206
Power Supply: 1200 Watt Modular (Don't know the brand without getting under my desk).

The tests ran from the local SSD as well as over a Gigabit Ethernet NFS Share running on a 16 2TB drive RAID-Z2 Array with a Crucial RealSSD 300 - 256GB drive acting as my ZIL.
In both cases, performance was identical.

The key difference between the tests is that under Mac and Linux, the tests ran all 64-bit, while in Windows the tests were conducted under Windows 7 Ultimate x64 and 32-bit VLC and Handbrake.

All tests were ran against 0.9.4 as well as the latest nightlies available as of the time of testing.

s55, is performance under Windows supposed to be comparable to Mac and Linux, could the fact that speeds are just over half on Windows be due to scalability on a 6-core processor with SSD?

Memory utilization sat right around 1.8GB on the Windows tests, while Mac and Linux had utilization sitting around 900MB, however I attribute this to operating system overhead rather than the Handbrake or VLC builds for Windows.
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

TysonEdwards wrote:s55, is performance under Windows supposed to be comparable to Mac and Linux, could the fact that speeds are just over half on Windows be due to scalability on a 6-core processor with SSD?

Memory utilization sat right around 1.8GB on the Windows tests, while Mac and Linux had utilization sitting around 900MB, however I attribute this to operating system overhead rather than the Handbrake or VLC builds for Windows.
??? Processor usage should scale the same under the 3 OSes. With the same settings, memory usage should be about the same too. The Windows CLI is 32-bit, which means it could be 10-15% slower than the 64-bit equivalents, not twice slower.

Where are your logs?
User avatar
s55
HandBrake Team
Posts: 10360
Joined: Sun Dec 24, 2006 1:05 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by s55 »

That much of a difference is either your encode setting were not matching up properly (would need a mac or lin vs windows logs for comparison) or there is something not right with windows with the way it;s scheduling cpu time. There could be some other process that's interfering with it. It's not uncommon to have AntiVirus and other utility apps screw with it.

One thing to check, make sure the process priority is not "below normal" for the CLI.
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

1) I will get the logs and post them here shortly.
2) As I said, I was using the default Apple Universal preset on each Operating System, so the odds of a setting not matching up seem pretty remote.
3) No Antivirus installed. Clean OS load with only drivers, Windows Updates, Handbrake and VLC installed.
4) Priority is set to Normal. Moving it to High had no impact in performance.

(Kinda glad that I ran these tests... maybe we've stumbled upon a bug...)
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

Code: Select all

# Windows GUI svn3686 2010112701
# Running: Microsoft Windows NT 6.1.7600.0
# CPU: AMD Phenom(tm) II X6 1090T Processor
# Ram: 4093 MB
# Screen: 2560x1440
# Temp Dir: C:\Users\Tyson Edwards\AppData\Local\Temp\
# Install Dir: C:\Program Files (x86)\Handbrake
# Data Dir: C:\Users\Tyson Edwards\AppData\Roaming\HandBrake\HandBrake\0.9.4.3684

# CLI Query:  -i "\\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi" -t 1 -c 1 -o "C:\Users\Tyson Edwards\Desktop\The Last Airbender [2010].avi-1.m4v"  -f mp4 -w 720 --loose-anamorphic  -e x264 -q 20 -a 1,1 -E faac,copy:ac3 -6 dpl2,auto -R Auto,Auto -B 160,auto -D 0.0,0.0 -x cabac=0:ref=2:me=umh:bframes=0:weightp=0:8x8dct=0:trellis=0:subq=6 -v 1
# User Query: False
-------------------------------------------

[10:13:24] hb_init: checking cpu count
[10:13:24] hb_init: starting libhb thread
HandBrake svn3686 (2010112701) - MinGW i386 - http://handbrake.fr
6 CPUs detected
Opening \\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi...
[10:13:24] hb_scan: path=\\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi, title_index=1
libbluray/bdnav/index_parse.c:157: indx_parse(): error opening \\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi/BDMV/index.bdmv
libbluray/bluray.c:960: nav_get_title_list(\\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi) failed (0x183cf40)
[10:13:24] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[10:13:24] dvd: not a dvd - trying as a stream/file instead
Input #0, avi, from '\\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi':
  Metadata:
    encoder         : AVI-Mux GUI 1.17.8.3, Feb 16 201019:42:507
    JUNK            : 
  Duration: 01:43:14.80, start: 0.000000, bitrate: 2004 kb/s
    Stream #0.0: Video: mpeg4, yuv420p, 720x304 [PAR 1:1 DAR 45:19], 23.98 tbr, 23.98 tbn, 23.98 tbc
    Stream #0.1: Audio: ac3, 48000 Hz, 5.1, s16, 384 kb/s
    Metadata:
      title           : VTS_02_1 T80 3_2ch 384Kbps DELAY 0ms
[10:13:24] scan: decoding previews for title 1
[10:13:24] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=384000 Unknown (AC3) (5.1 ch)
[10:13:24] scan: 10 previews, 720x304, 23.976 fps, autocrop = 0/0/0/0, aspect 2.37:1, PAR 1:1
[10:13:24] scan: title (0) job->width:720, job->height:304
Scanning title 1...
[10:13:24] libhb: scan thread found 1 valid title(s)
+ title 1:
  + stream: \\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi
  + duration: 01:43:14
  + size: 720x304, pixel aspect: 1/1, display aspect: 2.37, 23.976 fps
  + autocrop: 0/0/0/0
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 01:43:14
  + audio tracks:
    + 1, Unknown (AC3) (5.1 ch) (iso639-2: und), 48000Hz, 384000bps
  + subtitle tracks:
[10:13:24] 1 job(s) to process
[10:13:24] starting job
[10:13:24] sync: expecting 148550 video frames
[10:13:24] job configuration:
[10:13:24]  * source
[10:13:24]    + \\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi
[10:13:24]    + title 1, chapter(s) 1 to 1
[10:13:24]    + container: avi
[10:13:24]    + data rate: 2004 kbps
[10:13:24]  * destination
[10:13:24]    + C:\Users\Tyson Edwards\Desktop\The Last Airbender [2010].avi-1.m4v
[10:13:24]    + container: MPEG-4 (.mp4 and .m4v)
[10:13:24]  * video track
[10:13:24]    + decoder: mpeg4
[10:13:24]    + frame rate: same as source (around 23.976 fps)
[10:13:24]    + loose anamorphic
[10:13:24]      + storage dimensions: 720 * 304 -> 720 * 304, crop 0/0/0/0, mod 0
[10:13:24]      + pixel aspect ratio: 1 / 1
[10:13:24]      + display dimensions: 720 * 304
[10:13:24]    + encoder: x264
[10:13:24]      + options: cabac=0:ref=2:me=umh:bframes=0:weightp=0:8x8dct=0:trellis=0:subq=6
[10:13:24]      + quality: 20.00 (RF)
[10:13:24]  * audio track 0
[10:13:24]    + decoder: Unknown (AC3) (5.1 ch) (track 1, id 1)
[10:13:24]      + bitrate: 384 kbps, samplerate: 48000 Hz
[10:13:24]    + mixdown: Dolby Pro Logic II
[10:13:24]    + encoder: faac
[10:13:24]      + bitrate: 160 kbps, samplerate: 48000 Hz
[10:13:24]  * audio track 1
[10:13:24]    + decoder: Unknown (AC3) (5.1 ch) (track 1, id 1)
[10:13:24]      + bitrate: 384 kbps, samplerate: 48000 Hz
[10:13:24]    + AC3 passthrough
[10:13:24] encx264: min-keyint: auto (23), keyint: 240
[10:13:24] encx264: encoding with stored aspect 1/1
[10:13:24] encx264: Encoding at constant RF 20.000000
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Fast FastShuffle SSEMisalign LZCNT
x264 [info]: profile Constrained Baseline, level 3.0
No accelerated IMDCT transform found
No accelerated IMDCT transform found
[10:13:24] reader: first SCR 28800 id 1 DTS 28800
[10:24:50] reader: done. 1 scr changes
[10:24:51] work: average encoding speed for job is 216.327347 fps
[10:24:51] sync: got 148527 frames, 148550 expected
[10:24:51] mpeg4-decoder done: 148527 frames, 0 decoder errors, 0 drops
[10:24:51] render: lost time: 0 (0 frames)
[10:24:51] render: gained time: 0 (0 frames) (0 not accounted for)
x264 [info]: frame I:1538  Avg QP:17.82  size: 28273  PSNR Mean Y:46.28 U:52.42 V:51.41 Avg:47.40 Global:45.64
x264 [info]: frame P:146989 Avg QP:20.72  size:  7329  PSNR Mean Y:43.09 U:49.63 V:48.72 Avg:44.28 Global:43.02
x264 [info]: mb I  I16..4: 33.0%  0.0% 67.0%
x264 [info]: mb P  I16..4:  2.6%  0.0%  2.6%  P16..4: 47.5% 17.8%  7.7%  0.0%  0.0%    skip:21.8%
x264 [info]: coded y,uvDC,uvAC intra: 53.4% 69.4% 29.9% inter: 27.7% 21.3% 2.1%
x264 [info]: i16 v,h,dc,p: 36% 24% 24% 16%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 19% 23%  6%  7%  6%  6%  6%  6%
x264 [info]: i8c dc,h,v,p: 50% 21% 22%  6%
x264 [info]: ref P L0: 74.5% 25.5%
x264 [info]: SSIM Mean Y:0.9818498 (17.411db)
x264 [info]: PSNR Mean Y:43.123 U:49.656 V:48.746 Avg:44.314 Global:43.044 kb/s:1447.48
[10:24:52] mux: track 0, 148527 frames, 1120757918 bytes, 1447.43 kbps, fifo 16
[10:24:52] mux: track 1, 290345 frames, 123773399 bytes, 159.85 kbps, fifo 512
[10:24:52] mux: track 2, 193563 frames, 297312768 bytes, 383.97 kbps, fifo 256
[10:24:52] libhb: work result = 0
Rip done!
HandBrake has exited.
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

Thanks. I'm assuming we'll see the matching MacGUI and LinGUI logs in subsequent posts?
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

Correct.
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

Code: Select all

[11:02:25] gtkgui: HandBrake rev0 (2010050199) - Linux x86_64 - http://handbrake.fr
[11:02:26] hb_init: checking cpu count
[11:02:26] hb_init: starting libhb thread
[11:02:26] hb_init: checking cpu count
[11:02:26] hb_init: starting libhb thread
libdvdread: Encrypted DVD support unavailable.
[11:05:23] hb_scan: path=/The Last Airbender [2010].avi, title_index=0
[11:05:23] scan: trying to open with libdvdread
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[11:05:23] dvd: not a dvd - trying as a stream/file instead
Input #0, avi, from '/The Last Airbender [2010].avi':
  Metadata:
    ISFT            : AVI-Mux GUI 1.17.8.3, Feb 16 201019:42:507
    JUNK            : 
  Duration: 01:43:14.80, start: 0.000000, bitrate: 2004 kb/s
    Stream #0.0: Video: mpeg4, yuv420p, 720x304 [PAR 1:1 DAR 45:19], 23.98 tbr, 23.98 tbn, 23.98 tbc
    Stream #0.1: Audio: ac3, 48000 Hz, 5.1, s16, 384 kb/s
    Metadata:
      strn            : VTS_02_1 T80 3_2ch 384Kbps DELAY 0ms
[11:05:23] scan: decoding previews for title 1
[11:05:23] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=384000 Unknown (AC3) (5.1 ch)
[11:05:23] scan: 10 previews, 720x304, 23.976 fps, autocrop = 0/0/0/0, aspect 2.37:1, PAR 1:1
[11:05:23] scan: title (0) job->width:720, job->height:304
[11:05:23] libhb: scan thread found 1 valid title(s)
libdvdread: Encrypted DVD support unavailable.
[11:05:41] hb_scan: path=/The Last Airbender [2010].avi, title_index=1
[11:05:41] scan: trying to open with libdvdread
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[11:05:41] dvd: not a dvd - trying as a stream/file instead
Input #0, avi, from '/The Last Airbender [2010].avi':
  Metadata:
    ISFT            : AVI-Mux GUI 1.17.8.3, Feb 16 201019:42:507
    JUNK            : 
  Duration: 01:43:14.80, start: 0.000000, bitrate: 2004 kb/s
    Stream #0.0: Video: mpeg4, yuv420p, 720x304 [PAR 1:1 DAR 45:19], 23.98 tbr, 23.98 tbn, 23.98 tbc
    Stream #0.1: Audio: ac3, 48000 Hz, 5.1, s16, 384 kb/s
    Metadata:
      strn            : VTS_02_1 T80 3_2ch 384Kbps DELAY 0ms
[11:05:41] scan: decoding previews for title 1
[11:05:41] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=384000 Unknown (AC3) (5.1 ch)
[11:05:41] scan: 10 previews, 720x304, 23.976 fps, autocrop = 0/0/0/0, aspect 2.37:1, PAR 1:1
[11:05:41] scan: title (0) job->width:720, job->height:304
[11:05:41] libhb: scan thread found 1 valid title(s)
[11:05:43] gtkgui: Preset: Apple->Universal
[11:05:43] 1 job(s) to process
[11:05:43] starting job
[11:05:43] sync: expecting 148550 video frames
[11:05:43] job configuration:
[11:05:43]  * source
[11:05:43]    + /The Last Airbender [2010].avi
[11:05:43]    + title 1, chapter(s) 1 to 1
[11:05:43]    + container: avi
[11:05:43]    + data rate: 2004 kbps
[11:05:43]  * destination
[11:05:43]    + /home/ubuntu/Videos/The Last Airbender [2010].m4v
[11:05:43]    + container: MPEG-4 (.mp4 and .m4v)
[11:05:43]  * video track
[11:05:43]    + decoder: mpeg4
[11:05:43]    + frame rate: same as source (around 23.976 fps)
[11:05:43]    + loose anamorphic
[11:05:43]      + storage dimensions: 720 * 304 -> 720 * 304, crop 0/0/0/0, mod 16
[11:05:43]      + pixel aspect ratio: 1 / 1
[11:05:43]      + display dimensions: 720 * 304
[11:05:43]    + encoder: x264
[11:05:43]      + options: cabac=0:ref=2:me=umh:bframes=0:8x8dct=0:subme=6
[11:05:43]      + quality: 20.00 (RF)
[11:05:43]  * audio track 0
[11:05:43]    + decoder: Unknown (AC3) (5.1 ch) (track 1, id 1)
[11:05:43]      + bitrate: 384 kbps, samplerate: 48000 Hz
[11:05:43]    + mixdown: Dolby Pro Logic II
[11:05:43]    + encoder: faac
[11:05:43]      + bitrate: 160 kbps, samplerate: 48000 Hz
[11:05:43]  * audio track 1
[11:05:43]    + decoder: Unknown (AC3) (5.1 ch) (track 1, id 1)
[11:05:43]      + bitrate: 384 kbps, samplerate: 48000 Hz
[11:05:43]    + AC3 passthrough
[11:05:43] encx264: no bframes, disabling weight-p unless told otherwise
[11:05:43] encx264: min-keyint: 24, keyint: 240
[11:05:43] encx264: encoding with stored aspect 1/1
[11:05:43] encx264: Encoding at constant RF 20.000000
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Fast FastShuffle SSEMisalign LZCNT
[11:05:43] reader: first SCR 0 id 0 DTS 0
x264 [info]: profile Baseline, level 3.0
No accelerated IMDCT transform found
No accelerated IMDCT transform found
[11:05:43] sync: adding 384 ms of silence to audio 1  start 34560, next 0
[11:05:43] sync: adding 384 ms of silence to audio 1  start 34560, next 0
[11:11:31] reader: done. 1 scr changes
[11:11:31] work: average encoding speed for job is 359.637131 fps
[11:11:31] sync: got 148527 frames, 148550 expected
[11:11:31] mpeg4-decoder done: 148527 frames, 0 decoder errors, 0 drops
[11:11:31] render: lost time: 0 (0 frames)
[11:11:31] render: gained time: 0 (0 frames) (0 not accounted for)
x264 [info]: frame I:1116  Avg QP:16.98  size: 32717  PSNR Mean Y:46.46 U:52.70 V:51.70 Avg:47.61 Global:46.40
x264 [info]: frame P:147411 Avg QP:20.69  size:  7360  PSNR Mean Y:43.10 U:49.64 V:48.73 Avg:44.30 Global:43.03
x264 [info]: mb I  I16..4: 26.9%  0.0% 73.1%
x264 [info]: mb P  I16..4:  2.6%  0.0%  2.8%  P16..4: 47.6% 17.8%  7.7%  0.0%  0.0%    skip:21.5%
x264 [info]: coded y,uvDC,uvAC intra: 53.7% 69.4% 29.8% inter: 27.7% 21.3% 2.1%
x264 [info]: i16 v,h,dc,p: 36% 24% 24% 16%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 20% 18% 23%  6%  7%  7%  6%  6%  6%
x264 [info]: i8c dc,h,v,p: 50% 21% 22%  7%
x264 [info]: ref P L0: 74.4% 25.6%
x264 [info]: SSIM Mean Y:0.9818701
x264 [info]: PSNR Mean Y:43.130 U:49.666 V:48.751 Avg:44.323 Global:43.046 kb/s:1448.20
[11:11:31] mux: track 0, 148527 frames, 1121369126 bytes, 1448.14 kbps, fifo 64
[11:11:31] mux: track 1, 290360 frames, 123780250 bytes, 159.85 kbps, fifo 256
[11:11:31] mux: track 2, 193573 frames, 297328128 bytes, 383.97 kbps, fifo 256
[11:11:31] libhb: work result = 0
User avatar
s55
HandBrake Team
Posts: 10360
Joined: Sun Dec 24, 2006 1:05 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by s55 »

Are all 3 OS's running on this same box?

Also, can you take a note of the memory usage for the encode your currently doing.
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

You're not using the same version of handBrake on both machines:
TysonEdwards wrote:

Code: Select all

HandBrake svn3686 (2010112701) - MinGW i386 - http://handbrake.fr

[…]

[10:13:24] encx264: min-keyint: auto (23), keyint: 240

[…]

[10:13:24] reader: first SCR 28800 id 1 DTS 28800

[…]

[10:24:52] mux: track 0, 148527 frames, 1120757918 bytes, 1447.43 kbps, fifo 16
TysonEdwards wrote:

Code: Select all

[11:02:25] gtkgui: HandBrake rev0 (2010050199) - Linux x86_64 - http://handbrake.fr

[…]

[11:05:43] encx264: no bframes, disabling weight-p unless told otherwise
[11:05:43] encx264: min-keyint: 24, keyint: 240

[…]

[11:05:43] reader: first SCR 0 id 0 DTS 0

[…]

[11:05:43] sync: adding 384 ms of silence to audio 1  start 34560, next 0
[11:05:43] sync: adding 384 ms of silence to audio 1  start 34560, next 0

[…]

[11:11:31] mux: track 0, 148527 frames, 1121369126 bytes, 1448.14 kbps, fifo 64
Moreover, the Linux build doesn't appear to be an official build.
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

The other difference, which I missed at first:
TysonEdwards wrote:

Code: Select all

[10:13:24] hb_scan: path=\\BLACKBIRD\media\toConvert\The Last Airbender [2010].avi, title_index=1
TysonEdwards wrote:

Code: Select all

[11:05:23] hb_scan: path=/The Last Airbender [2010].avi, title_index=0
In one case, you appear to be accessing the source from the network (slow Windows encode), whereas in the other the source seems to be located on the boot drive…
TysonEdwards
Posts: 11
Joined: Thu Feb 22, 2007 1:25 am

Re: Performance Comparison between Windows, Mac and Linux?

Post by TysonEdwards »

You are correct, It appears that I provided the Ubuntu Repository build of Handbrake from local disk. I also have the Ubuntu svn3688 build, and will be providing it's logs shortly.

Yes, all three OSes have been set up on the same hardware to evaluate effective performance under each Operating System to decide what it looks like I will stick with long-term.
I have only noted overall memory utilization (Windows: 1.8GB, Mac 871MB, Linux: 798MB), not the amount used by Handbrake in it's encodes.

I will look at memory utilization on each OS for the Handbrake processes and post that as well.

Windows tests have also been conducted from the SSD.
In any case, the network is running via Gigabit with an NFS Share to a 16 Disk RAID-Z2 configuration and a ZIL on a 256GB SSD (Crucial RealSSD 300).
Network throughput is tested sustained at 94.1MB/s under Windows, 94.7MB/s under Mac, 93.8MB/s under Linux, so running over the network is definitely not a bottleneck here, as that outperforms most local disks.
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

Same source, same settings, same machine, same local drive (NTFS partition for the Windows encode, HFS+ partition for the OS X encode), same HandBrake version:

Windows XP Pro 32-bit, WindowsGUI w/32-bit CLI (svn3688):

Code: Select all

# Windows GUI svn3688 2010112801
# Running: Microsoft Windows NT 5.1.2600 Service Pack 3
# CPU: Intel(R) Core(TM) i5 CPU         760  @ 2.80GHz
# Ram: 2047 MB
# Screen: 2560x1440
# Temp Dir: C:\Documents and Settings\Flight Simulator X\Local Settings\Temp\
# Install Dir: C:\Program Files\Handbrake
# Data Dir: C:\Documents and Settings\Flight Simulator X\Application Data\HandBrake\HandBrake\0.9.4.3688

# CLI Query:  -i "C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv" -t 1 -c 1 -o "C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.m4v"  -f mp4 -w 720 --loose-anamorphic  -e x264 -q 20 -a 1,1 -E faac,copy:ac3 -6 dpl2,auto -R Auto,Auto -B 160,auto -D 0.0,0.0 --markers="C:\Documents and Settings\Flight Simulator X\Local Settings\Temp\LOTR-1-chapters.csv" -x cabac=0:ref=2:me=umh:bframes=0:weightp=0:8x8dct=0:trellis=0:subq=6 -v 1
# User Query: False
-------------------------------------------

[20:24:28] hb_init: checking cpu count
[20:24:28] hb_init: starting libhb thread
HandBrake svn3688 (2010112801) - MinGW i386 - http://handbrake.fr
4 CPUs detected
Opening C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv...
[20:24:28] hb_scan: path=C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv, title_index=1
libbluray/bdnav/index_parse.c:157: indx_parse(): error opening C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv/BDMV/index.bdmv
libbluray/bluray.c:960: nav_get_title_list(C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv) failed (0x189b7d8)
[20:24:28] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[20:24:28] dvd: not a dvd - trying as a stream/file instead
Input #0, matroska,webm, from 'C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv':
  Duration: 00:03:59.52, start: 0.000000, bitrate: 9396 kb/s
    Stream #0.0: Video: mpeg2video, yuv420p, 720x576 [PAR 64:45 DAR 16:9], 8500 kb/s, 25 fps, 25 tbr, 1k tbn, 50 tbc
    Stream #0.1(eng): Audio: ac3, 48000 Hz, 5.1, s16, 448 kb/s
    Stream #0.2(fre): Audio: ac3, 48000 Hz, 5.1, s16, 448 kb/s
[20:24:28] scan: decoding previews for title 1
[20:24:28] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
[20:24:28] scan: audio 0x2: AC-3, rate=48000Hz, bitrate=448000 Francais (AC3) (5.1 ch)
[20:24:28] scan: 10 previews, 720x576, 25.000 fps, autocrop = 74/76/0/0, aspect 16:9, PAR 64:45
[20:24:28] scan: title (0) job->width:720, job->height:304
[20:24:28] libhb: scan thread found 1 valid title(s)
+ title 1:
  + stream: C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv
  + duration: 00:03:59
  + size: 720x576, pixel aspect: 64/45, display aspect: 1.78, 25.000 fps
  + autocrop: 74/76/0/0
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 00:03:59
  + audio tracks:
    + 1, English (AC3) (5.1 ch) (iso639-2: eng), 48000Hz, 448000bps
    + 2, Francais (AC3) (5.1 ch) (iso639-2: fra), 48000Hz, 448000bps
  + subtitle tracks:
Reading chapter markers from file C:\Documents and Settings\Flight Simulator X\Local Settings\Temp\LOTR-1-chapters.csv
[20:24:28] 1 job(s) to process
[20:24:28] starting job
[20:24:28] sync: expecting 6013 video frames
[20:24:28] work: only 1 chapter, disabling chapter markers
[20:24:28] job configuration:
[20:24:28]  * source
[20:24:28]    + C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.mkv
[20:24:28]    + title 1, chapter(s) 1 to 1
[20:24:28]    + container: matroska,webm
[20:24:28]    + data rate: 9396 kbps
[20:24:28]  * destination
[20:24:28]    + C:\Documents and Settings\Flight Simulator X\Desktop\LOTR.m4v
[20:24:28]    + container: MPEG-4 (.mp4 and .m4v)
[20:24:28]  * video track
[20:24:28]    + decoder: mpeg2video
[20:24:28]      + bitrate 8500 kbps
[20:24:28]    + frame rate: same as source (around 25.000 fps)
[20:24:28]    + loose anamorphic
[20:24:28]      + storage dimensions: 720 * 576 -> 720 * 432, crop 74/76/0/0, mod 0
[20:24:28]      + pixel aspect ratio: 173 / 120
[20:24:28]      + display dimensions: 1038 * 432
[20:24:28]    + encoder: x264
[20:24:28]      + options: cabac=0:ref=2:me=umh:bframes=0:weightp=0:8x8dct=0:trellis=0:subq=6
[20:24:28]      + quality: 20.00 (RF)
[20:24:28]  * audio track 0
[20:24:28]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[20:24:28]      + bitrate: 448 kbps, samplerate: 48000 Hz
[20:24:28]    + mixdown: Dolby Pro Logic II
[20:24:28]    + encoder: faac
[20:24:28]      + bitrate: 160 kbps, samplerate: 48000 Hz
[20:24:28]  * audio track 1
[20:24:28]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[20:24:28]      + bitrate: 448 kbps, samplerate: 48000 Hz
[20:24:28]    + AC3 passthrough
[20:24:28] encx264: encoding with stored aspect 173/120
[20:24:28] encx264: Encoding at constant RF 20.000000
x264 [info]: using SAR=173/120
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2
[20:24:28] reader: first SCR 0 id 0 DTS 0
x264 [info]: profile Constrained Baseline, level 3.0
No accelerated IMDCT transform found
No accelerated IMDCT transform found
[20:25:35] reader: done. 1 scr changes
[20:25:37] work: average encoding speed for job is 88.799690 fps
[20:25:37] sync: got 5988 frames, 6013 expected
[20:25:37] mpeg2video-decoder done: 5988 frames, 0 decoder errors, 0 drops
[20:25:37] render: lost time: 0 (0 frames)
[20:25:37] render: gained time: 0 (0 frames) (0 not accounted for)
x264 [info]: frame I:111   Avg QP:19.25  size: 28670  PSNR Mean Y:46.10 U:50.86 V:50.72 Avg:47.16 Global:46.79
x264 [info]: frame P:5877  Avg QP:21.80  size:  9330  PSNR Mean Y:42.37 U:48.39 V:48.02 Avg:43.59 Global:43.27
x264 [info]: mb I  I16..4: 20.9%  0.0% 79.1%
x264 [info]: mb P  I16..4:  1.1%  0.0%  4.6%  P16..4: 47.1% 25.3%  8.7%  0.0%  0.0%    skip:13.2%
x264 [info]: coded y,uvDC,uvAC intra: 76.3% 69.4% 22.7% inter: 35.0% 24.0% 0.7%
x264 [info]: i16 v,h,dc,p: 24% 19%  9% 48%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 19% 16%  7%  9%  8%  9%  7%  6%
x264 [info]: i8c dc,h,v,p: 54% 18% 22%  6%
x264 [info]: ref P L0: 79.6% 20.4%
x264 [info]: SSIM Mean Y:0.9766200 (16.312db)
x264 [info]: PSNR Mean Y:42.444 U:48.434 V:48.072 Avg:43.652 Global:43.314 kb/s:1937.76
[20:25:37] mux: track 0, 5988 frames, 58013240 bytes, 1937.33 kbps, fifo 8
[20:25:37] mux: track 1, 11228 frames, 4787021 bytes, 159.86 kbps, fifo 512
[20:25:37] mux: track 2, 7485 frames, 13413120 bytes, 447.93 kbps, fifo 256
[20:25:37] libhb: work result = 0
Rip done!
HandBrake has exited.

Code: Select all

[20:25:37] work: average encoding speed for job is 88.799690 fps
Mac OS X 10.6.5, 64-bit MacGUI (svn3688):

Code: Select all

HandBrake Activity Log for /Users/tim/Desktop/LOTR.m4v: 2010-11-28 20:40:27 +0100
Handbrake Version: svn3688 x86_64 (2010112801)

[20:40:27] macgui: Rip: Pending queue count is 0
[20:40:27] macgui: getNextPendingQueueIndex next pending encod index is:0
[20:40:27] macgui: scanning specifically for title: 1
[20:40:27] hb_scan: path=/Users/tim/Desktop/LOTR.mkv, title_index=1
libbluray/bdnav/index_parse.c:157: indx_parse(): error opening /Users/tim/Desktop/LOTR.mkv/BDMV/index.bdmv
libbluray/bluray.c:960: nav_get_title_list(/Users/tim/Desktop/LOTR.mkv) failed (0x10291d000)
[20:40:27] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Using libdvdcss version 1.2.10 for DVD access
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[20:40:27] dvd: not a dvd - trying as a stream/file instead
Input #0, matroska,webm, from '/Users/tim/Desktop/LOTR.mkv':
  Duration: 00:03:59.52, start: 0.000000, bitrate: 9396 kb/s
    Stream #0.0: Video: mpeg2video, yuv420p, 720x576 [PAR 64:45 DAR 16:9], 8500 kb/s, 25 fps, 25 tbr, 1k tbn, 50 tbc
    Stream #0.1(eng): Audio: ac3, 48000 Hz, 5.1, s16, 448 kb/s
    Stream #0.2(fre): Audio: ac3, 48000 Hz, 5.1, s16, 448 kb/s
[20:40:27] scan: decoding previews for title 1
[20:40:27] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
[20:40:27] scan: audio 0x2: AC-3, rate=48000Hz, bitrate=448000 Francais (AC3) (5.1 ch)
[20:40:27] scan: 30 previews, 720x576, 25.000 fps, autocrop = 74/76/0/0, aspect 16:9, PAR 64:45
[20:40:27] scan: title (0) job->width:720, job->height:304
[20:40:27] libhb: scan thread found 1 valid title(s)
[20:40:27] macgui: ScanDone state received from fQueueEncodeLibhb
[20:40:27] macgui: Preset: Universal
[20:40:27] macgui: processNewQueueEncode number of passes expected is: 1
[20:40:27] macgui: Start / Stop set to chapters
[20:40:27] macgui: prepareJob exiting
[20:40:27] 1 job(s) to process
[20:40:27] starting job
[20:40:27] sync: expecting 6013 video frames
[20:40:27] job configuration:
[20:40:27]  * source
[20:40:27]    + /Users/tim/Desktop/LOTR.mkv
[20:40:27]    + title 1, chapter(s) 1 to 1
[20:40:27]    + container: matroska,webm
[20:40:27]    + data rate: 9396 kbps
[20:40:27]  * destination
[20:40:27]    + /Users/tim/Desktop/LOTR.m4v
[20:40:27]    + container: MPEG-4 (.mp4 and .m4v)
[20:40:27]  * video track
[20:40:27]    + decoder: mpeg2video
[20:40:27]      + bitrate 8500 kbps
[20:40:27]    + frame rate: same as source (around 25.000 fps)
[20:40:27]    + loose anamorphic
[20:40:27]      + storage dimensions: 720 * 576 -> 720 * 432, crop 74/76/0/0, mod 16
[20:40:27]      + pixel aspect ratio: 173 / 120
[20:40:27]      + display dimensions: 1038 * 432
[20:40:27]    + encoder: x264
[20:40:27]      + options: cabac=0:ref=2:me=umh:bframes=0:weightp=0:8x8dct=0:trellis=0:subq=6
[20:40:27]      + quality: 20.00 (RF)
[20:40:27]  * audio track 0
[20:40:27]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[20:40:27]      + bitrate: 448 kbps, samplerate: 48000 Hz
[20:40:27]    + mixdown: Dolby Pro Logic II
[20:40:27]    + encoder: faac
[20:40:27]      + bitrate: 160 kbps, samplerate: 48000 Hz
[20:40:27]  * audio track 1
[20:40:27]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[20:40:27]      + bitrate: 448 kbps, samplerate: 48000 Hz
[20:40:27]    + AC3 passthrough
[20:40:27] encx264: encoding with stored aspect 173/120
[20:40:27] encx264: Encoding at constant RF 20.000000
x264 [info]: using SAR=173/120
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2
[20:40:27] reader: first SCR 0 id 0 DTS 0
x264 [info]: profile Constrained Baseline, level 3.0
No accelerated IMDCT transform found
No accelerated IMDCT transform found
[20:41:33] reader: done. 1 scr changes
[20:41:35] work: average encoding speed for job is 89.763588 fps
[20:41:35] sync: got 5988 frames, 6013 expected
[20:41:35] mpeg2video-decoder done: 5988 frames, 0 decoder errors, 0 drops
[20:41:35] render: lost time: 0 (0 frames)
[20:41:35] render: gained time: 0 (0 frames) (0 not accounted for)
x264 [info]: frame I:111   Avg QP:19.25  size: 28670  PSNR Mean Y:46.10 U:50.86 V:50.72 Avg:47.16 Global:46.79
x264 [info]: frame P:5877  Avg QP:21.80  size:  9330  PSNR Mean Y:42.37 U:48.39 V:48.02 Avg:43.59 Global:43.27
x264 [info]: mb I  I16..4: 20.9%  0.0% 79.1%
x264 [info]: mb P  I16..4:  1.1%  0.0%  4.6%  P16..4: 47.1% 25.3%  8.7%  0.0%  0.0%    skip:13.2%
x264 [info]: coded y,uvDC,uvAC intra: 76.3% 69.4% 22.7% inter: 35.0% 24.0% 0.7%
x264 [info]: i16 v,h,dc,p: 24% 19%  9% 48%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 19% 16%  7%  9%  8%  9%  7%  6%
x264 [info]: i8c dc,h,v,p: 54% 18% 22%  6%
x264 [info]: ref P L0: 79.6% 20.4%
x264 [info]: SSIM Mean Y:0.9766200 (16.312db)
x264 [info]: PSNR Mean Y:42.444 U:48.434 V:48.072 Avg:43.652 Global:43.314 kb/s:1937.76
[20:41:35] mux: track 0, 5988 frames, 58013240 bytes, 1937.33 kbps, fifo 8
[20:41:35] mux: track 1, 11228 frames, 4787073 bytes, 159.86 kbps, fifo 512
[20:41:35] mux: track 2, 7485 frames, 13413120 bytes, 447.93 kbps, fifo 256
[20:41:35] libhb: work result = 0

Code: Select all

[20:41:35] work: average encoding speed for job is 89.763588 fps
User avatar
s55
HandBrake Team
Posts: 10360
Joined: Sun Dec 24, 2006 1:05 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by s55 »

Take the network out of the equation. It's entirely possible that the MinGW build has issues with networking on windows. (not something we can control)

And by overall memory I assume you mean used by the OS, and not by the HandBrakeCLI process?
kosobai
Posts: 15
Joined: Sun Apr 26, 2009 12:08 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by kosobai »

I can also vouch that Windows encodes are in the region of THREE TIMES slower than Linux encodes.

Running an AMD 1065t at stock speeds, the computer achieved average encodes of 190 fps using the normal profile and a PAL DVD source on Ubuntu 11.04 64 bit. On Windows 7 64 bit, and with the same settings, the same source encoded at an average of 60 fps! Both encodes were ripped directly from the DVD.

I expected a slight difference in speed, but Handbrake on Windows effectively cancels out four of the six processor cores!
Deleted User 11865

Re: Performance Comparison between Windows, Mac and Linux?

Post by Deleted User 11865 »

Logs or it didn't happen (i.e. you weren't using the same settings - with the logs we'll be able to tell you which settings were different).
kosobai
Posts: 15
Joined: Sun Apr 26, 2009 12:08 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by kosobai »

Looks like this could be the problem:


libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdread: Could not open input: Permission denied
libdvdread: Can't open D: for reading
libdvdread: Device (null) inaccessible, CSS authentication not available.
NAME OPEN FAILED
libdvdnav: Unable to find home directorylibdvdnav: DVD disk reports itself with Region mask 0x00f50000. Regions: 2 4
libdvdread: Encrypted DVD support unavailable.
libdvdread: Could not open input: Permission denied
libdvdread: Can't open D: for reading
libdvdread: Device (null) inaccessible, CSS authentication not available.

VLC is installed. I can't be bothered p*ing about trying to get it to work under Windows, especially as Ubuntu runs fine. Good-bye!
User avatar
s55
HandBrake Team
Posts: 10360
Joined: Sun Dec 24, 2006 1:05 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by s55 »

VLC isn't used by the Windows version of HandBrake ....
If your encoding a copy protected source, it's obviously going to be slower due to the "noise" that your encoding and likely a ton of read errors.
kosobai
Posts: 15
Joined: Sun Apr 26, 2009 12:08 pm

Re: Performance Comparison between Windows, Mac and Linux?

Post by kosobai »

s55 wrote:VLC isn't used by the Windows version of HandBrake ....
If your encoding a copy protected source, it's obviously going to be slower due to the "noise" that your encoding and likely a ton of read errors.
That would make sense. The DVD was encrypted, and yes the video was scrambled and the audio patchy.
Post Reply