(External) x265 nightly builds with Handbrake nightly builds?
Forum rules
An Activity Log is required for support requests. Please read How-to get an activity log? for details on how and why this should be provided.
An Activity Log is required for support requests. Please read How-to get an activity log? for details on how and why this should be provided.
(External) x265 nightly builds with Handbrake nightly builds?
As far as I understand (from here) x265 10 and 12 bit dll's are now baked into the nightly Handbrake releases. Still I'd like to test the nightly builds of x265 (e.g. from http://msystem.waw.pl/x265/) with Handbrake, but putting those into the Handbrake install directory doesn't seem to work anymore. Is there a way to make Handbrake nightly prefer the dll's in the install directory over the baked in encoders?
Last edited by rmjap on Wed Nov 15, 2017 5:33 pm, edited 1 time in total.
- JohnAStebbins
- HandBrake Team
- Posts: 5723
- Joined: Sat Feb 09, 2008 7:21 pm
Re: (External) x265 nightly builds with Handbrake nightly builds?
Nope. Can't make everyone happy unfortunately. For most people it's more convenient to have them baked in.
Re: (External) x265 nightly builds with Handbrake nightly builds?
Thanks for the quick reply. Any way you could provide me with a nightly from before the integration of the dll's?
Re: (External) x265 nightly builds with Handbrake nightly builds?
Nope. They are not kept and we won’t update it to account for x265 changes anyway. So the only option is to compile from source and back port any changes required yourself.
Re: (External) x265 nightly builds with Handbrake nightly builds?
Setting up the build environment is a handful, but once you're done a full rebuild is rather easy, FWIW.
Re: (External) x265 nightly builds with Handbrake nightly builds?
I'll try that, thanks.
Re: (External) x265 nightly builds with Handbrake nightly builds?
The performance of the new integrated build seems a fair bit worse than I was getting with the AVX2 build. Since updating I'm getting under 4 FPS average, with the AVX2 + old nightly I typically got about 5.5-5.6. I can try to do a before/after (I think I still have an old nightly installer) to be more specific with a single test case, but can you tell me if the integrated x265 includes any optimizations?
-
- Veteran User
- Posts: 4854
- Joined: Wed May 04, 2011 11:06 pm
Re: (External) x265 nightly builds with Handbrake nightly builds?
Could you please post your logs from both encodes, instructions can be found here:jamietre wrote: ↑Sun Nov 19, 2017 7:46 pm The performance of the new integrated build seems a fair bit worse than I was getting with the AVX2 build. Since updating I'm getting under 4 FPS average, with the AVX2 + old nightly I typically got about 5.5-5.6. I can try to do a before/after (I think I still have an old nightly installer) to be more specific with a single test case, but can you tell me if the integrated x265 includes any optimizations?
https://handbrake.fr/docs/en/latest/hel ... y-log.html
Re: (External) x265 nightly builds with Handbrake nightly builds?
Just finished a complete test on a 10 minute fragment it was almost exactly the same FPS. So my bad, I'm guessing the PC was under some server load I didn't know about when I first saw what looked like a perf difference.
However, I am seeing a different problem with a couple isolated sources: encoding aborts early. This has been happening as long as I've been using the external libraries with the AVX2 Visual Studio builds, but not the GCC builds. I figured it had to do with some incompatibility with using the external lib & that specific build, but it's still happening now with the built-in x265 build in the current nightly.
I've been using: x265 2.5+5-0b3ba15b33ea:[Windows][MSVC 1911][64 bit] 10bit
The new build is: x265 2.5:[Windows][GCC 5.3.1][64 bit] 10bit
Here's the log from a failed encode using a recent nightly with built-in x265. This seems like the relevant part
[00:19:52] sync: got 3743 frames, 191145 expected
However, I am seeing a different problem with a couple isolated sources: encoding aborts early. This has been happening as long as I've been using the external libraries with the AVX2 Visual Studio builds, but not the GCC builds. I figured it had to do with some incompatibility with using the external lib & that specific build, but it's still happening now with the built-in x265 build in the current nightly.
I've been using: x265 2.5+5-0b3ba15b33ea:[Windows][MSVC 1911][64 bit] 10bit
The new build is: x265 2.5:[Windows][GCC 5.3.1][64 bit] 10bit
Here's the log from a failed encode using a recent nightly with built-in x265. This seems like the relevant part
[00:19:52] sync: got 3743 frames, 191145 expected
Code: Select all
HandBrake Nightly 20171113130119-17a4bb7-master (2017111501) - 64bit
OS: Microsoft Windows NT 10.0.16299.0 - 64bit
CPU: AMD Ryzen 7 1700 Eight-Core Processor
Ram: 8147 MB,
GPU Information:
NVIDIA GeForce GTX 1050 Ti - 23.21.13.8813
Screen: 1920x1080
Temp Dir: C:\Users\exjk\AppData\Local\Temp\
Install Dir: C:\Program Files\HandBrake Nightly
Data Dir: C:\Users\exjk\AppData\Roaming\HandBrake Team\HandBrake\1.1.0.0
-------------------------------------------
# Starting Encode ...
[00:10:38] hb_init: starting libhb thread
[00:10:38] 1 job(s) to process
[00:10:38] json job:
{
"Audio": {
"AudioList": [
{
"DRC": 0.0,
"Encoder": 1125984256,
"Gain": 0.0,
"Mixdown": -1,
"NormalizeMixLevel": false,
"Samplerate": 0,
"Track": 0,
"DitherMethod": 0
}
],
"CopyMask": [
1073807360,
1073743872,
1074003968,
1073750016,
1090519040,
1074790400,
1074266112,
1107296256
],
"FallbackEncoder": 65536
},
"Destination": {
"ChapterList": [
{
"Name": "Chapter 1"
},
{
"Name": "Chapter 2"
},
{
"Name": "Chapter 3"
},
{
"Name": "Chapter 4"
},
{
"Name": "Chapter 5"
},
{
"Name": "Chapter 6"
},
{
"Name": "Chapter 7"
},
{
"Name": "Chapter 8"
},
{
"Name": "Chapter 9"
},
{
"Name": "Chapter 10"
},
{
"Name": "Chapter 11"
},
{
"Name": "Chapter 12"
},
{
"Name": "Chapter 13"
},
{
"Name": "Chapter 14"
}
],
"ChapterMarkers": true,
"AlignAVStart": false,
"File": "P:\\VideoLibrary\\Processed\\Fantastic Beasts and Where to Find Them (2016)\\Fantastic Beasts And Where To Find Them (2016).mkv",
"Mp4Options": {
"IpodAtom": false,
"Mp4Optimize": false
},
"Mux": 2097152
},
"Filters": {
"FilterList": [
{
"ID": 11,
"Settings": {
"crop-bottom": "140",
"crop-left": "0",
"crop-right": "0",
"crop-top": "140",
"height": "800",
"width": "1920"
}
},
{
"ID": 6,
"Settings": {
"mode": "0"
}
}
]
},
"PAR": {
"Num": 1,
"Den": 1
},
"Metadata": {},
"SequenceID": 0,
"Source": {
"Angle": 1,
"Range": {
"Type": "chapter",
"Start": 1,
"End": 14
},
"Title": 1,
"Path": "P:\\BluRayOriginals\\Fantastic Beasts and Where to Find Them (2016)\\Fantastic Beasts and Where to Find Them (2016).mkv"
},
"Subtitle": {
"Search": {
"Burn": false,
"Default": false,
"Enable": true,
"Forced": true
},
"SubtitleList": [
{
"Burn": false,
"Default": false,
"Forced": false,
"ID": 1,
"Offset": 0,
"Track": 0
}
]
},
"Video": {
"Encoder": 8192,
"Level": "auto",
"TwoPass": false,
"Turbo": false,
"ColorMatrixCode": 0,
"Options": "",
"Preset": "slow",
"Profile": "auto",
"Quality": 21.0,
"HWDecode": false,
"QSV": {
"Decode": false,
"AsyncDepth": 0
}
}
}
[00:10:38] CPU:
[00:10:38] - logical processor count: 16
[00:10:38] Intel Quick Sync Video support: yes
[00:10:38] - Intel Media SDK software: API 1.23 (minimum: 1.3)
[00:10:38] - H.264 encoder: yes
[00:10:38] - preferred implementation: software (null)
[00:10:38] - capabilities (software): bpyramid vsinfo opt1 opt2
[00:10:38] - H.265 encoder: no
[00:10:38] hb_scan: path=P:\BluRayOriginals\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts and Where to Find Them (2016).mkv, title_index=1
udfread ERROR: ECMA 167 Volume Recognition failed
src/libbluray/disc/disc.c:323: failed opening UDF image P:\BluRayOriginals\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts and Where to Find Them (2016).mkv
src/libbluray/disc/disc.c:424: error opening file BDMV\index.bdmv
src/libbluray/disc/disc.c:424: error opening file BDMV\BACKUP\index.bdmv
[00:10:38] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 5.0.3
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[00:10:38] dvd: not a dvd - trying as a stream/file instead
Input #0, matroska,webm, from 'P:\BluRayOriginals\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts and Where to Find Them (2016).mkv':
Metadata:
title : Fantastic Beasts and Where to Find Them
Duration: 02:12:52.34, start: 0.000000, bitrate: N/A
Chapter #0:0: start 0.000000, end 520.269750
Metadata:
title : Chapter 01
Chapter #0:1: start 520.269750, end 1135.717917
Metadata:
title : Chapter 02
Chapter #0:2: start 1135.717917, end 1703.660292
Metadata:
title : Chapter 03
Chapter #0:3: start 1703.660292, end 2314.186875
Metadata:
title : Chapter 04
Chapter #0:4: start 2314.186875, end 2888.594042
Metadata:
title : Chapter 05
Chapter #0:5: start 2888.594042, end 3499.245750
Metadata:
title : Chapter 06
Chapter #0:6: start 3499.245750, end 4154.692208
Metadata:
title : Chapter 07
Chapter #0:7: start 4154.692208, end 4646.391750
Metadata:
title : Chapter 08
Chapter #0:8: start 4646.391750, end 5373.659958
Metadata:
title : Chapter 09
Chapter #0:9: start 5373.659958, end 5882.084542
Metadata:
title : Chapter 10
Chapter #0:10: start 5882.084542, end 6627.871250
Metadata:
title : Chapter 11
Chapter #0:11: start 6627.871250, end 7144.470667
Metadata:
title : Chapter 12
Chapter #0:12: start 7144.470667, end 7451.944500
Metadata:
title : Chapter 13
Chapter #0:13: start 7451.944500, end 7972.341333
Metadata:
title : Chapter 14
Stream #0:0(eng): Video: h264 (High)
yuv420p, 1920x1080 [PAR 1:1 DAR 16:9], PAR 1:1 DAR 16:9
23.98 fps, 1k tbn
Metadata:
BPS-eng : 22003967
DURATION-eng : 02:12:52.339375000
NUMBER_OF_FRAMES-eng: 191145
NUMBER_OF_BYTES-eng: 21927885904
SOURCE_ID-eng : 001011
_STATISTICS_WRITING_APP-eng: MakeMKV v1.10.6 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2017-07-09 15:05:01
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream #0:1(eng): Audio: ac3
48000 Hz, 5.1, fltp, 448 kb/s (default)
Metadata:
title : Surround 5.1
BPS-eng : 448000
DURATION-eng : 02:12:52.352000000
NUMBER_OF_FRAMES-eng: 249136
NUMBER_OF_BYTES-eng: 446451712
SOURCE_ID-eng : 001100
_STATISTICS_WRITING_APP-eng: MakeMKV v1.10.6 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2017-07-09 15:05:01
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream #0:2(eng): Audio: dts (DTS)
48000 Hz, 5.1, fltp, 1536 kb/s
Metadata:
title : Surround 5.1
BPS-eng : 1509000
DURATION-eng : 02:12:52.341333333
NUMBER_OF_FRAMES-eng: 747407
NUMBER_OF_BYTES-eng: 1503782884
SOURCE_ID-eng : 001101
_STATISTICS_WRITING_APP-eng: MakeMKV v1.10.6 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2017-07-09 15:05:01
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream #0:3(eng): Audio: ac3
48000 Hz, 5.1, fltp, 448 kb/s
Metadata:
title : Surround 5.1
BPS-eng : 448000
DURATION-eng : 02:12:52.352000000
NUMBER_OF_FRAMES-eng: 249136
NUMBER_OF_BYTES-eng: 446451712
SOURCE_ID-eng : 001102
_STATISTICS_WRITING_APP-eng: MakeMKV v1.10.6 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2017-07-09 15:05:01
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream #0:4(eng): Subtitle: hdmv_pgs_subtitle
Metadata:
BPS-eng : 28444
DURATION-eng : 02:11:35.450062500
NUMBER_OF_FRAMES-eng: 3198
NUMBER_OF_BYTES-eng: 28073157
SOURCE_ID-eng : 001200
_STATISTICS_WRITING_APP-eng: MakeMKV v1.10.6 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2017-07-09 15:05:01
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
[00:10:38] scan: decoding previews for title 1
[00:10:38] scan: audio 0x1: ac3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch) (Dolby Digital EX)
[00:10:38] scan: audio 0x2: dca, rate=48000Hz, bitrate=1536000 English (DTS) (5.1 ch)
[00:10:38] scan: audio 0x3: ac3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
[00:10:39] scan: 10 previews, 1920x1080, 23.976 fps, autocrop = 140/140/0/0, aspect 16:9, PAR 1:1
[00:10:39] scan: supported video decoders: avcodec qsv
[00:10:40] libhb: scan thread found 1 valid title(s)
[00:10:40] starting job
[00:10:40] job configuration:
[00:10:40] * source
[00:10:40] + P:\BluRayOriginals\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts and Where to Find Them (2016).mkv
[00:10:40] + title 1, chapter(s) 1 to 14
[00:10:40] + container: matroska,webm
[00:10:40] * destination
[00:10:40] + P:\VideoLibrary\Processed\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts And Where To Find Them (2016).mkv
[00:10:40] + container: Matroska (libavformat)
[00:10:40] + chapter markers
[00:10:40] * video track
[00:10:40] + decoder: h264
[00:10:40] + filters
[00:10:40] + Framerate Shaper (mode=0)
[00:10:40] + frame rate: same as source (around 23.976 fps)
[00:10:40] + Crop and Scale (width=1920:height=800:crop-top=140:crop-bottom=140:crop-left=0:crop-right=0)
[00:10:40] + source: 1920 * 1080, crop (140/140/0/0): 1920 * 800, scale: 1920 * 800
[00:10:40] + Output geometry
[00:10:40] + storage dimensions: 1920 x 800
[00:10:40] + pixel aspect ratio: 1 : 1
[00:10:40] + display dimensions: 1920 x 800
[00:10:40] * Foreign Audio Search: Passthrough, Forced Only
[00:10:40] + subtitle, English [PGS] (track 0, id 0x4, Picture)
[00:10:40] sync: expecting 191145 video frames
[matroska,webm @ 000001d8d3b98100] Invalid track number 44
[00:10:43] reader: done. 1 scr changes
[00:10:43] work: average encoding speed for job is 0.000000 fps
[00:10:43] vfr: lost time: 0 (0 frames)
[00:10:43] vfr: gained time: 0 (0 frames) (0 not accounted for)
[00:10:43] h264-decoder done: 0 frames, 0 decoder errors
[00:10:43] sync: got 0 frames, 191145 expected
[00:10:43] Subtitle track 0 (id 0x4) 'English [PGS]': 6 hits (0 forced)
[00:10:43] No candidate detected during subtitle scan
[00:10:43] starting job
[00:10:43] Auto Passthru: allowed codecs are AAC, AC3, E-AC3, TrueHD, DTS, DTS-HD, MP3, FLAC
[00:10:43] Auto Passthru: fallback is AAC (avcodec)
[00:10:43] Auto Passthru: using AC3 Passthru for track 1
[00:10:43] job configuration:
[00:10:43] * source
[00:10:43] + P:\BluRayOriginals\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts and Where to Find Them (2016).mkv
[00:10:43] + title 1, chapter(s) 1 to 14
[00:10:43] + container: matroska,webm
[00:10:43] * destination
[00:10:43] + P:\VideoLibrary\Processed\Fantastic Beasts and Where to Find Them (2016)\Fantastic Beasts And Where To Find Them (2016).mkv
[00:10:43] + container: Matroska (libavformat)
[00:10:43] + chapter markers
[00:10:43] * video track
[00:10:43] + decoder: h264
[00:10:43] + filters
[00:10:43] + Framerate Shaper (mode=0)
[00:10:43] + frame rate: same as source (around 23.976 fps)
[00:10:43] + Crop and Scale (width=1920:height=800:crop-top=140:crop-bottom=140:crop-left=0:crop-right=0)
[00:10:43] + source: 1920 * 1080, crop (140/140/0/0): 1920 * 800, scale: 1920 * 800
[00:10:43] + Output geometry
[00:10:43] + storage dimensions: 1920 x 800
[00:10:43] + pixel aspect ratio: 1 : 1
[00:10:43] + display dimensions: 1920 x 800
[00:10:43] + encoder: H.265 10-bit (libx265)
[00:10:43] + preset: slow
[00:10:43] + profile: auto
[00:10:43] + quality: 21.00 (RF)
[00:10:43] * subtitle track 1, English [PGS] (track 0, id 0x4, Picture) -> Passthrough
[00:10:43] * audio track 1
[00:10:43] + decoder: English (AC3) (5.1 ch) (Dolby Digital EX) (track 1, id 0x1)
[00:10:43] + bitrate: 448 kbps, samplerate: 48000 Hz
[00:10:43] + AC3 Passthru
[00:10:43] sync: expecting 191145 video frames
x265 [info]: HEVC encoder version 2.5
x265 [info]: build info [Windows][GCC 5.3.1][64 bit] 10bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main 10 profile, Level-4 (Main tier)
x265 [info]: Thread pool created using 16 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 4 / wpp(13 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : star / 57 / 3 / 3
x265 [info]: Keyframe min / max / scenecut / bias: 24 / 240 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 25 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 4 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-21.0 / 0.60
x265 [info]: tools: rect limit-modes rd=4 psy-rd=2.00 rdoq=2 psy-rdoq=1.00
x265 [info]: tools: rskip signhide tmvp strong-intra-smoothing lslices=4
x265 [info]: tools: deblock sao
[00:10:43] sync: first pts video is 0
[00:10:43] sync: "Chapter 1" (1) at frame 1 time 0
[00:10:43] sync: first pts audio 0x1 is 0
[h264 @ 000001d8d6d844c0] cabac decode of qscale diff failed at 103 56
[h264 @ 000001d8d6d844c0] error while decoding MB 103 56, bytestream 8736
[00:15:03] sync: first pts subtitle 0x4 is 6734250
[ac3 @ 000001d8d6d88120] exponent out-of-range
[ac3 @ 000001d8d6d88120] error decoding the audio block
[matroska,webm @ 000001d8da992980] Invalid track number 44
[00:19:31] reader: done. 1 scr changes
[00:19:52] work: average encoding speed for job is 6.939464 fps
[00:19:52] vfr: lost time: 0 (0 frames)
[00:19:52] vfr: gained time: 0 (0 frames) (0 not accounted for)
[00:19:52] ac3-decoder done: 4881 frames, 0 decoder errors
[00:19:52] h264-decoder done: 3743 frames, 0 decoder errors
[00:19:52] sync: got 3743 frames, 191145 expected
[00:19:52] sync: framerate min 23.981 fps, max 23.981 fps, avg 23.976 fps
x265 [info]: frame I: 27, Avg QP:19.66 kb/s: 11580.41
x265 [info]: frame P: 986, Avg QP:21.73 kb/s: 9033.06
x265 [info]: frame B: 2730, Avg QP:26.07 kb/s: 1484.33
x265 [info]: Weighted P-Frames: Y:17.0% UV:11.5%
x265 [info]: consecutive B-frames: 9.5% 12.9% 10.8% 32.3% 34.6%
encoded 3743 frames in 548.92s (6.82 fps), 3545.68 kb/s, Avg QP:24.88
[00:19:52] mux: track 0, 3743 frames, 69206416 bytes, 3543.61 kbps, fifo 2048
[00:19:52] mux: track 1, 4881 frames, 8746752 bytes, 447.86 kbps, fifo 2048
[00:19:52] mux: track 2, 12 frames, 105410 bytes, 5.40 kbps, fifo 16
[00:19:52] libhb: work result = 0
# Encode Completed ...
Re: (External) x265 nightly builds with Handbrake nightly builds?
Imagine our surprise! It's almost like they should put up pink banner with some bold underlined red text so we get the activity logs the first time.
Re: (External) x265 nightly builds with Handbrake nightly builds?
I really just asked a question the first time, which was, does the new build include CPU optimizations.
I also posted logs for another issue. Sorry to have been a bother, and I appreciate all the hard work, Handbrake is a great tool.