Which Version supports ALL CORES rendering?

[keavygroup]

Description of problem or question:

I have a 24 core MacPro 5,1. Past HandBrake versions used all 24 to render... I LOVED this because it's WHY I have this machine. Latest version is only using 12. Please spare me the diminishing return talk. I only want to know what is the latest version that won't worry about # of cores being throttled.

THANK YOU in advance of me sequentially trying all versions...

(& Yes I manually crank all fans up when 24 cores are blazing)


Steps to reproduce the problem (If Applicable):

activity monitoring shows CPU utilization it's clearly every other core of the 24 at about 55%-70% speed while rendering


HandBrake version (e.g., 1.0.0):

1.3.1


Operating system and version (e.g., Ubuntu 16.04 LTS, macOS 10.13 High Sierra, Windows 10 Creators Update):

10.14.6


HandBrake Activity Log ***required*** (see How-to get an activity log)

Code: Select all

Please replace this text with the contents of your log file between the two code tags - OR -  provide a pastebin URL in place of these 3 lines.
If you are unable to do so, please state why so we can help you.

[Ritsuka]

Encoders can't scale up to an infinite number of core. And many filters can bottleneck the whole process.
If you want to use all the cores at 100%, often only way is to run multiple encoders at the same time. Try a nightly build of HandBrake, there is an option in the Advanced preferences to run up to 4 encodes at the same time.

Another difference is that most of the presets enable the deinterlace detection and deinterlace by default. If your source is not interlaced, disable those filters.

[rollin_eng]

Could you please post your HB logs, instructions can be found here:

https://handbrake.fr/docs/en/latest/hel ... y-log.html

[mduell]

An Activity Log is required for support requests. Please read How-to get an activity log? for details on how and why this should be provided.

The answer to this question is without doubt directly a result of the source you're providing and settings you're choosing. Need to see logs from "before" and now to point out what you're doing differently.

[keavygroup]

THANK YOU ALL for responding. It did force me to do the other encode I wanted to take 4K ProRes footage and transcode to 4K Roku. When I fired it up below you can see all 24 cores are engaged... (YEA!)

The previous encode where only 12 were engaged I took a 4K ProRes transcoded to a 1080P AVC .MP4.

Interesting that one the 4K encode engages all 24 and the other didn't.

Good stuff thank you for asking for the log because it forced me to look at it more closely. I would like the 1080 encode to take less time tho- If there is a preset that WOULD engage all that is great.

Thanks again for trying to help-

[20:58:26] macgui: Handbrake Version: 1.3.1 (2020010400)
[20:58:26] hb_init: starting libhb thread
[20:58:26] macgui: Error domain: NSCocoaErrorDomain
[20:58:26] macgui: Error code: 4
[20:58:26] macgui: Error description: The file doesn’t exist.
[20:58:26] macgui: Error debug description: Error Domain=NSCocoaErrorDomain Code=4 "The file doesn’t exist."
[20:58:26] Compile-time hardening features are enabled
[20:58:26] hb_init: starting libhb thread
[21:02:21] macgui: ScanCore scanning titles with a duration of 10 seconds or more
[21:02:21] CPU: Intel(R) Xeon(R) CPU X5680 @ 3.33GHz
[21:02:21] - logical processor count: 24
[21:02:21] hb_scan: path=/Volumes/RAID 10/Paris Spring 20 HQ.mov, title_index=0
udfread ERROR: ECMA 167 Volume Recognition failed
disc.c:323: failed opening UDF image /Volumes/RAID 10/Paris Spring 20 HQ.mov
disc.c:424: error opening file BDMV/index.bdmv
disc.c:424: error opening file BDMV/BACKUP/index.bdmv
bluray.c nav_get_title_list(/Volumes/RAID 10/Paris Spring 20 HQ.mov/) failed
[21:02:21] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 6.0.1
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[21:02:21] dvd: not a dvd - trying as a stream/file instead
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/Volumes/RAID 10/Paris Spring 20 HQ.mov':
Metadata:
major_brand : qt
minor_version : 0
compatible_brands: qt
creation_time : 2020-04-22T23:04:20.000000Z
com.apple.quicktime.keywords: 5-31-19
com.apple.quicktime.description: This video is about Paris Spring 20 cropped
com.apple.quicktime.author: (My Name)
com.apple.quicktime.displayname: Paris Spring 20 cropped
com.apple.quicktime.title: Paris Spring 20 cropped
Duration: 01:40:12.42, start: 0.000000, bitrate: 374152 kb/s
Stream #0:0(und): Audio: pcm_s24le (lpcm / 0x6D63706C), 44100 Hz, stereo, s32 (24 bit), 2116 kb/s (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Audio
Stream #0:1(und): Video: prores (HQ) (apch / 0x68637061), yuv422p10le(tv, bt709, progressive), 3840x2160, 371639 kb/s, SAR 1:1 DAR 16:9, 24 fps, 24 tbr, 2400 tbn, 2400 tbc (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Video
encoder : Apple ProRes 422 HQ
timecode : 00:00:00:00
Stream #0:2(und): Data: none (tmcd / 0x64636D74) (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Time Code
timecode : 00:00:00:00
[21:02:21] scan: decoding previews for title 1
[21:02:21] scan: audio 0x0: pcm_s24le, rate=44100Hz, bitrate=2116800 Unknown (pcm_s24le) (2.0 ch) (2116 kbps)
[21:02:25] scan: 10 previews, 3840x2160, 24.000 fps, autocrop = 412/470/138/26, aspect 16:9, PAR 1:1
[21:02:25] libhb: scan thread found 1 valid title(s)
[21:02:25] macgui: ScanCore scan done
[21:03:29] macgui: Failed to create bookmark: Error Domain=NSCocoaErrorDomain Code=256 "Could not open() the item" UserInfo={NSURL=file:///Users/mk/Library/Containers/fr.handbrake.HandBrake/Data/Movies/, NSDebugDescription=Could not open() the item}
[21:03:29] macgui: Failed to create bookmark: Error Domain=NSCocoaErrorDomain Code=256 "Could not open() the item" UserInfo={NSURL=file:///Users/mk/Library/Containers/fr.handbrake.HandBrake/Data/Movies/, NSDebugDescription=Could not open() the item}
[21:03:29] macgui: QueueCore scanning specifically for title: 1
[21:03:29] CPU: Intel(R) Xeon(R) CPU X5680 @ 3.33GHz
[21:03:29] - logical processor count: 24
[21:03:29] hb_scan: path=/Volumes/RAID 10/Paris Spring 20 HQ.mov, title_index=1
udfread ERROR: ECMA 167 Volume Recognition failed
disc.c:323: failed opening UDF image /Volumes/RAID 10/Paris Spring 20 HQ.mov
disc.c:424: error opening file BDMV/index.bdmv
disc.c:424: error opening file BDMV/BACKUP/index.bdmv
bluray.c nav_get_title_list(/Volumes/RAID 10/Paris Spring 20 HQ.mov/) failed
[21:03:29] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 6.0.1
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[21:03:29] dvd: not a dvd - trying as a stream/file instead
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/Volumes/RAID 10/Paris Spring 20 HQ.mov':
Metadata:
major_brand : qt
minor_version : 0
compatible_brands: qt
creation_time : 2020-04-22T23:04:20.000000Z
com.apple.quicktime.keywords: 5-31-19
com.apple.quicktime.description: This video is about Paris Spring 20 cropped
com.apple.quicktime.author: (My Name)
com.apple.quicktime.displayname: Paris Spring 20 cropped
com.apple.quicktime.title: Paris Spring 20 cropped
Duration: 01:40:12.42, start: 0.000000, bitrate: 374152 kb/s
Stream #0:0(und): Audio: pcm_s24le (lpcm / 0x6D63706C), 44100 Hz, stereo, s32 (24 bit), 2116 kb/s (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Audio
Stream #0:1(und): Video: prores (HQ) (apch / 0x68637061), yuv422p10le(tv, bt709, progressive), 3840x2160, 371639 kb/s, SAR 1:1 DAR 16:9, 24 fps, 24 tbr, 2400 tbn, 2400 tbc (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Video
encoder : Apple ProRes 422 HQ
timecode : 00:00:00:00
Stream #0:2(und): Data: none (tmcd / 0x64636D74) (default)
Metadata:
creation_time : 2020-04-22T23:04:20.000000Z
handler_name : Core Media Time Code
timecode : 00:00:00:00
[21:03:30] scan: decoding previews for title 1
[21:03:30] scan: audio 0x0: pcm_s24le, rate=44100Hz, bitrate=2116800 Unknown (pcm_s24le) (2.0 ch) (2116 kbps)
[21:03:33] scan: 10 previews, 3840x2160, 24.000 fps, autocrop = 412/470/138/26, aspect 16:9, PAR 1:1
[21:03:33] libhb: scan thread found 1 valid title(s)
[21:03:33] macgui: Failed to create bookmark: Error Domain=NSCocoaErrorDomain Code=256 "Could not open() the item" UserInfo={NSURL=file:///Users/mk/Library/Containers/fr.handbrake.HandBrake/Data/Movies/, NSDebugDescription=Could not open() the item}
[21:03:33] macgui: QueueCore scan done
[21:03:33] macgui: QueueCore started encoding Paris Spring 20 HQ.mkv
[21:03:33] macgui: QueueCore with preset Roku 2160p60 4K HEVC Surround (Modified)
[21:03:33] Starting work at: Sat Apr 25 21:03:33 2020

[21:03:33] 1 job(s) to process
[21:03:33] Starting Task: Encoding Pass
[21:03:33] work: only 1 chapter, disabling chapter markers
[21:03:33] job configuration:
[21:03:33] * source
[21:03:33] + /Volumes/RAID 10/Paris Spring 20 HQ.mov
[21:03:33] + title 1, chapter(s) 1 to 1
[21:03:33] + container: mov,mp4,m4a,3gp,3g2,mj2
[21:03:33] + data rate: 374152 kbps
[21:03:33] * destination
[21:03:33] + /Users/mk/Library/Containers/fr.handbrake.HandBrake/Data/Movies/Paris Spring 20 HQ.mkv
[21:03:33] + container: Matroska (libavformat)
[21:03:33] * video track
[21:03:33] + decoder: prores
[21:03:33] + bitrate 371639 kbps
[21:03:33] + filters
[21:03:33] + Framerate Shaper (mode=2:rate=27000000/450000)
[21:03:33] + frame rate: 24.000 fps -> peak rate limited to 60.000 fps
[21:03:33] + Crop and Scale (width=3676:height=1278:crop-top=412:crop-bottom=470:crop-left=138:crop-right=26)
[21:03:33] + source: 3840 * 2160, crop (412/470/138/26): 3676 * 1278, scale: 3676 * 1278
[21:03:33] + Output geometry
[21:03:33] + storage dimensions: 3676 x 1278
[21:03:33] + pixel aspect ratio: 1 : 1
[21:03:33] + display dimensions: 3676 x 1278
[21:03:33] + encoder: H.265 (libx265)
[21:03:33] + preset: slow
[21:03:33] + options: strong-intra-smoothing=0:rect=0:aq-mode=1
[21:03:33] + profile: main
[21:03:33] + level: auto
[21:03:33] + quality: 24.00 (RF)
[21:03:33] + color profile: 1-1-1
[21:03:33] * audio track 1
[21:03:33] + decoder: Unknown (pcm_s24le) (2.0 ch) (2116 kbps) (track 1, id 0x0)
[21:03:33] + bitrate: 2116 kbps, samplerate: 44100 Hz
[21:03:33] + mixdown: Stereo
[21:03:33] + dither: triangular
[21:03:33] + encoder: AAC (Apple AudioToolbox)
[21:03:33] + bitrate: 160 kbps, samplerate: 44100 Hz
[21:03:33] sync: expecting 144298 video frames
x265 [info]: HEVC encoder version 3.2.1+1-b5c86a64bbbe
x265 [info]: build info [Mac OS X][clang 11.0.0][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2
x265 [info]: Main profile, Level-5 (Main tier)
x265 [info]: Thread pool created using 24 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 4 / wpp(20 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : star / 57 / 3 / 3
x265 [info]: Keyframe min / max / scenecut / bias: 24 / 240 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 25 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 4 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-24.0 / 0.60
x265 [info]: tools: limit-modes rd=4 psy-rd=2.00 rdoq=2 psy-rdoq=1.00 rskip
x265 [info]: tools: signhide tmvp lslices=4 deblock sao
[21:03:34] sync: first pts video is 0
[21:03:34] sync: "Chapter 1" (1) at frame 1 time 0
[21:03:34] sync: first pts audio 0x0 is 0

[mduell]

Yea, x265 currently can't make good use of 24 cores for an HD encode (the source resolution is irrelevant) with those specific settings, thus it only scales to about 12 with those specific settings at that resolution. You could make changes that would use more cores, but it may be slower rather than faster and/or change the efficiency (quality for size) of the encode.

If you want to keep the CPU busy with HD encodes on those settings, run 2 at the same time. Also you only have 12 hardware cores (with 24 threads scheduled on them), so all you can get from using the other 12 threads is about 10-15%.

[Deleted User 13735]

How about if Handbrake used enough (optimal) cores instead?
x265 is better at utilizing >8 logical processors than x264, but forcing all cores can actually slow things down from overhead collateral.