Heavy pixelation of reds

[MiniSiets]

I just noticed after doing some recent encodes that HandBrake seems to have a problem with handling various solid shades of red. The picture becomes heavily pixelated around them. This only seems to occur with h.265 10-bit encodes. 8-bit and 12-bit do not reproduce this problem, nor even if you do h.264 10-bit, but it's quite consistently reproducible just by setting to h.265 10-bit, all other settings remaining default.

HandBrake version 1.1.2 (though I also saw it doing this in 1.1.1)

I was using the Super HQ 1080p30 Surround preset and mostly just leaving everything as default except adjusting the codec to h.265 10-bit, framerate same as source, and slow encoder preset.

OS Windows 7 64-bit SP1

Here's a sample image for comparison, taken from the same shot of footage under 2 different encodes: https://i.imgur.com/yZMjceE.png

I blew the image up to double size so the pixelation would be more visible. You can see the difference pretty clearly.

Is anyone else noticing this?

[rollin_eng]

Could you please post your HB logs, instructions can be found here:

https://handbrake.fr/docs/en/latest/hel ... y-log.html

[MiniSiets]

HandBrake 1.1.2 (2018090500) - 64bit
OS: Microsoft Windows NT 6.1.7601 Service Pack 1 - 64bit
CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
Ram: 16340 MB,
GPU Information:
NVIDIA GeForce GTX 1070 - 24.21.13.9882
Screen: 1920x1080
Temp Dir: C:\Users\Siets\AppData\Local\Temp\
Install Dir: C:\Program Files\HandBrake
Data Dir: C:\Users\Siets\AppData\Roaming\HandBrake

-------------------------------------------


# Starting Encode ...

[02:42:08] hb_init: starting libhb thread
[02:42:08] 1 job(s) to process
[02:42:08] json job:
{
"Audio": {
"AudioList": [
{
"Bitrate": 320,
"DRC": 0.0,
"Encoder": 65536,
"Gain": 0.0,
"Mixdown": 4,
"NormalizeMixLevel": false,
"Samplerate": 48000,
"Name": "English 2.0",
"Track": 0,
"DitherMethod": 0
},
{
"Bitrate": 320,
"DRC": 0.0,
"Encoder": 65536,
"Gain": 0.0,
"Mixdown": 4,
"NormalizeMixLevel": false,
"Samplerate": 48000,
"Name": "Japanese 2.0",
"Track": 1,
"DitherMethod": 0
}
],
"CopyMask": [
1073807360,
1073743872,
1074003968,
1073750016,
1090519040,
1074790400,
1074266112,
1107296256
],
"FallbackEncoder": 2048
},
"Destination": {
"ChapterList": [],
"ChapterMarkers": false,
"AlignAVStart": false,
"File": "C:\\Users\\Siets\\Desktop\\fsnubw1.mkv",
"Mp4Options": {
"IpodAtom": false,
"Mp4Optimize": false
},
"Mux": 2097152
},
"Filters": {
"FilterList": [
{
"ID": 4,
"Settings": {
"mode": "7"
}
},
{
"ID": 3,
"Settings": {
"block-height": "16",
"block-thresh": "40",
"block-width": "16",
"filter-mode": "2",
"mode": "3",
"motion-thresh": "1",
"spatial-metric": "2",
"spatial-thresh": "1"
}
},
{
"ID": 11,
"Settings": {
"crop-bottom": "0",
"crop-left": "0",
"crop-right": "0",
"crop-top": "0",
"height": "1080",
"width": "1920"
}
},
{
"ID": 6,
"Settings": {
"mode": "1"
}
}
]
},
"PAR": {
"Num": 1,
"Den": 1
},
"Metadata": {},
"SequenceID": 0,
"Source": {
"Angle": 1,
"Range": {
"Type": "chapter",
"Start": 1,
"End": 1
},
"Title": 1,
"Path": "C:\\Users\\Siets\\Desktop\\00000.m2ts"
},
"Subtitle": {
"Search": {
"Burn": false,
"Default": false,
"Enable": false,
"Forced": false
},
"SubtitleList": [
{
"Burn": false,
"Default": false,
"Forced": false,
"ID": 2,
"Offset": 0,
"Track": 1
}
]
},
"Video": {
"Encoder": 8192,
"Level": "auto",
"TwoPass": false,
"Turbo": false,
"ColorMatrixCode": 0,
"Options": "",
"Preset": "slow",
"Profile": "auto",
"Quality": 17.0,
"HWDecode": false,
"QSV": {
"Decode": false,
"AsyncDepth": 0
}
}
}
[02:42:08] CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
[02:42:08] - Intel microarchitecture Skylake
[02:42:08] - logical processor count: 8
[02:42:08] Intel Quick Sync Video support: no
[02:42:08] hb_scan: path=C:\Users\Siets\Desktop\00000.m2ts, title_index=1
udfread ERROR: ECMA 167 Volume Recognition failed
src/libbluray/disc/disc.c:323: failed opening UDF image C:\Users\Siets\Desktop\00000.m2ts
src/libbluray/disc/disc.c:424: error opening file BDMV\index.bdmv
src/libbluray/disc/disc.c:424: error opening file BDMV\BACKUP\index.bdmv
[02:42:08] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 6.0.0
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[02:42:08] dvd: not a dvd - trying as a stream/file instead
[02:42:08] file is MPEG Transport Stream with 192 byte packets offset 4 bytes
[02:42:08] Found the following PIDS
[02:42:08] Video PIDS :
[02:42:08] 0x1011 type H.264 (0x1b)
[02:42:08] Audio PIDS :
[02:42:08] 0x1100 type BD LPCM (0x80)
[02:42:08] 0x1101 type BD LPCM (0x80)
[02:42:08] Subtitle PIDS :
[02:42:08] 0x1200 type PGS Subtitle (0x90)
[02:42:08] 0x1201 type PGS Subtitle (0x90)
[02:42:08] 0x1202 type PGS Subtitle (0x90)
[02:42:08] Other PIDS :
[02:42:08] 0x1001 type Unknown (0xff) (PCR)
[02:42:08] stream id 0x1100 (type 0x80 substream 0x0) audio 0x1100
[02:42:08] stream id 0x1101 (type 0x80 substream 0x0) audio 0x1101
[02:42:08] stream id 0x1200 (type 0x90 substream 0x0) subtitle 0x1200
[02:42:08] stream id 0x1201 (type 0x90 substream 0x0) subtitle 0x1201
[02:42:08] stream id 0x1202 (type 0x90 substream 0x0) subtitle 0x1202
[02:42:08] stream doesn't seem to have video IDR frames
[02:42:08] scan: decoding previews for title 1
[02:42:08] file is MPEG Transport Stream with 192 byte packets offset 4 bytes
[02:42:08] scan: audio 0x1100: pcm_bluray, rate=48000Hz, bitrate=1536000 Unknown (BD LPCM) (2.0 ch)
[02:42:08] scan: audio 0x1101: pcm_bluray, rate=48000Hz, bitrate=2304000 Unknown (BD LPCM) (2.0 ch)
[02:42:10] stream: 17 good frames, 0 errors (0%)
[02:42:10] scan: 10 previews, 1920x1080, 23.976 fps, autocrop = 0/0/0/0, aspect 16:9, PAR 1:1
[02:42:10] scan: supported video decoders: avcodec qsv
[02:42:10] libhb: scan thread found 1 valid title(s)
[02:42:10] starting job
[02:42:10] decomb filter thread started for segment 0
[02:42:10] decomb filter thread started for segment 1
[02:42:10] decomb filter thread started for segment 2
[02:42:10] decomb filter thread started for segment 3
[02:42:10] decomb filter thread started for segment 4
[02:42:10] decomb filter thread started for segment 5
[02:42:10] decomb filter thread started for segment 6
[02:42:10] decomb filter thread started for segment 7
[02:42:10] decomb check thread started for segment 0
[02:42:10] decomb check thread started for segment 1
[02:42:10] decomb check thread started for segment 2
[02:42:10] decomb check thread started for segment 3
[02:42:10] decomb check thread started for segment 5
[02:42:10] decomb check thread started for segment 4
[02:42:10] decomb check thread started for segment 6
[02:42:10] decomb check thread started for segment 7
[02:42:10] mask filter thread started for segment 0
[02:42:10] mask filter thread started for segment 1
[02:42:10] mask filter thread started for segment 2
[02:42:10] mask filter thread started for segment 3
[02:42:10] mask filter thread started for segment 4
[02:42:10] mask filter thread started for segment 5
[02:42:10] mask filter thread started for segment 6
[02:42:10] mask filter thread started for segment 7
[02:42:10] mask erode thread started for segment 0
[02:42:10] mask erode thread started for segment 1
[02:42:10] mask erode thread started for segment 2
[02:42:10] mask erode thread started for segment 3
[02:42:10] mask erode thread started for segment 4
[02:42:10] mask erode thread started for segment 5
[02:42:10] mask erode thread started for segment 6
[02:42:10] mask erode thread started for segment 7
[02:42:10] mask dilate thread started for segment 0
[02:42:10] mask dilate thread started for segment 1
[02:42:10] mask dilate thread started for segment 2
[02:42:10] mask dilate thread started for segment 3
[02:42:10] mask dilate thread started for segment 4
[02:42:10] mask dilate thread started for segment 5
[02:42:10] mask dilate thread started for segment 6
[02:42:10] mask dilate thread started for segment 7
[02:42:10] yadif thread started for segment 0
[02:42:10] yadif thread started for segment 1
[02:42:10] yadif thread started for segment 2
[02:42:10] yadif thread started for segment 3
[02:42:10] yadif thread started for segment 4
[02:42:10] yadif thread started for segment 5
[02:42:10] yadif thread started for segment 6
[02:42:10] yadif thread started for segment 7
[02:42:10] work: track 1, dithering not supported by codec
[02:42:10] work: track 2, dithering not supported by codec
[02:42:10] job configuration:
[02:42:10] * source
[02:42:10] + C:\Users\Siets\Desktop\00000.m2ts
[02:42:10] + title 1, chapter(s) 1 to 1
[02:42:10] * destination
[02:42:10] + C:\Users\Siets\Desktop\fsnubw1.mkv
[02:42:10] + container: Matroska (libavformat)
[02:42:10] * video track
[02:42:10] + decoder: h264
[02:42:10] + bitrate 200 kbps
[02:42:10] + filters
[02:42:10] + Comb Detect (mode=3:spatial-metric=2:motion-thresh=1:spatial-thresh=1:filter-mode=2:block-thresh=40:block-width=16:block-height=16)
[02:42:10] + Decomb (mode=39)
[02:42:10] + Framerate Shaper (mode=1)
[02:42:10] + frame rate: 23.976 fps -> constant 23.976 fps
[02:42:10] + Crop and Scale (width=1920:height=1080:crop-top=0:crop-bottom=0:crop-left=0:crop-right=0)
[02:42:10] + source: 1920 * 1080, crop (0/0/0/0): 1920 * 1080, scale: 1920 * 1080
[02:42:10] + Output geometry
[02:42:10] + storage dimensions: 1920 x 1080
[02:42:10] + pixel aspect ratio: 1 : 1
[02:42:10] + display dimensions: 1920 x 1080
[02:42:10] + encoder: H.265 10-bit (libx265)
[02:42:10] + preset: slow
[02:42:10] + profile: auto
[02:42:10] + quality: 17.00 (RF)
[02:42:10] * subtitle track 1, Unknown [PGS] (track 1, id 0x1201, Picture) -> Passthrough
[02:42:10] * audio track 1
[02:42:10] + name: English 2.0
[02:42:10] + decoder: Unknown (BD LPCM) (2.0 ch) (track 1, id 0x1100)
[02:42:10] + bitrate: 1536 kbps, samplerate: 48000 Hz
[02:42:10] + mixdown: Stereo
[02:42:10] + encoder: AAC (libavcodec)
[02:42:10] + bitrate: 320 kbps, samplerate: 48000 Hz
[02:42:10] * audio track 2
[02:42:10] + name: Japanese 2.0
[02:42:10] + decoder: Unknown (BD LPCM) (2.0 ch) (track 2, id 0x1101)
[02:42:10] + bitrate: 2304 kbps, samplerate: 48000 Hz
[02:42:10] + mixdown: Stereo
[02:42:10] + encoder: AAC (libavcodec)
[02:42:10] + bitrate: 320 kbps, samplerate: 48000 Hz
[02:42:10] file is MPEG Transport Stream with 192 byte packets offset 4 bytes
[02:42:10] sync: expecting 72356 video frames
x265 [info]: HEVC encoder version 2.6
x265 [info]: build info [Windows][GCC 7.3.0][64 bit] 10bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main 10 profile, Level-4 (Main tier)
x265 [info]: Thread pool created using 8 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 3 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : star / 57 / 3 / 3
x265 [info]: Keyframe min / max / scenecut / bias: 24 / 240 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 25 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 4 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-17.0 / 0.60
x265 [info]: tools: rect limit-modes rd=4 psy-rd=2.00 rdoq=2 psy-rdoq=1.00
x265 [info]: tools: rskip signhide tmvp strong-intra-smoothing lslices=4
x265 [info]: tools: deblock sao
[02:42:10] sync: first pts audio 0x1100 is 0
[02:42:10] sync: first pts audio 0x1101 is 0
[02:42:10] sync: first pts video is 0
[02:46:19] sync: first pts subtitle 0x1201 is 4313058
[05:27:39] hb_ts_stream_decode - eof
[05:27:39] reader: done. 1 scr changes
[05:28:13] work: average encoding speed for job is 7.329522 fps
[05:28:13] comb detect: heavy 30 | light 1202 | uncombed 71625 | total 72857
[05:28:13] decomb: deinterlaced 30 | blended 1202 | unfiltered 71625 | total 72857
[05:28:13] vfr: 72857 frames output, 0 dropped and 0 duped for CFR/PFR
[05:28:13] vfr: lost time: 0 (0 frames)
[05:28:13] vfr: gained time: 0 (0 frames) (0 not accounted for)
[05:28:13] stream: 72858 good frames, 0 errors (0%)
[05:28:13] pcm_bluray-decoder done: 607758 frames, 0 decoder errors
[05:28:13] pcm_bluray-decoder done: 607758 frames, 0 decoder errors
[05:28:13] h264-decoder done: 72857 frames, 0 decoder errors
[05:28:13] sync: got 72857 frames, 72356 expected
[05:28:13] sync: framerate min 11.989 fps, max 23.981 fps, avg 23.976 fps
x265 [info]: frame I: 723, Avg QP:13.19 kb/s: 24136.07
x265 [info]: frame P: 19763, Avg QP:14.63 kb/s: 5201.98
x265 [info]: frame B: 52371, Avg QP:21.62 kb/s: 537.20
x265 [info]: Weighted P-Frames: Y:2.3% UV:1.9%
x265 [info]: consecutive B-frames: 8.6% 4.5% 41.0% 14.4% 31.5%
encoded 72857 frames in 9963.07s (7.31 fps), 2036.74 kb/s, Avg QP:19.64
[05:28:13] mux: track 0, 72857 frames, 773933094 bytes, 2037.45 kbps, fifo 2048
[05:28:13] mux: track 1, 142444 frames, 121179482 bytes, 319.02 kbps, fifo 4096
[05:28:13] mux: track 2, 142444 frames, 120112698 bytes, 316.21 kbps, fifo 4096
[05:28:13] mux: track 3, 4285 frames, 96855449 bytes, 254.98 kbps, fifo 128
[05:28:13] libhb: work result = 0

# Encode Completed ...

[Woodstock]

It's not just the reds, but that's where it is most noticeable in the frames you show.

What happens if you shut off deinterlace/decombing completely?

[MiniSiets]

Alright I tested turning off decomb completely. Doesn't seem to affect it either, still pixelated. I thought about turning it off earlier but then I figured since it doesn't do it on 8-bit or 12-bit with decomb turned on, decomb doesn't seem to play a factor anyway.

Also keep in mind that the image I provided was blown up 2x so the other stuff may look slightly pixelated as well, but that's only as a result of me resizing the image so you can see the red pixels more clearly for comparison. The pixelation really only seems to be affecting shades of red; particularly the most vibrant shades of it.