[Invalid] Some batch's hang the sequence in 0.99 and 0.98

Archive of historical bug reports.
Please use the GitHub link above to report issues.
Forum rules
*******************************
Please be aware we are now using GitHub for issue tracking and feature requests.
- This section of the forum is now closed to new topics.

*******************************
Aeneas

[Invalid] Some batch's hang the sequence in 0.99 and 0.98

Post by Aeneas » Thu Jun 06, 2013 11:43 pm

In a batch of 100's of files, maybe 1 in 50 hangs the sequence.
The CPU still appears to be consumed with an apparent Handbrake conversion,
but [NO] progress on the conversion is occurring.
Stopping the Handbrake conversion and then retrying as a single non-batched conversion
in a 2nd Handbrake instance always works.
This problem may be slightly worse in Handbrake 0.99 compared to 0.98 version.

//Q6600//Windows 7 64 Ultimate//12 GBytes Sdram//MSI Nvidia 670// .

Code: Select all

HandBrake 0.9.9.5530 - 64bit Version
OS: Microsoft Windows NT 6.1.7601 Service Pack 1
CPU: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
Ram: 12286 MB, Screen: 1920x1200
Temp Dir: C:\Users\ZZZZ\AppData\Local\Temp\
Install Dir: C:\Program Files\Handbrake
Data Dir: C:\Users\ZZZZ\AppData\Roaming\HandBrake\HandBrake\0.9.9.5530

-------------------------------------------
CLI Query:  -i "O:\vlc-record-2013-01-17-.ts" -t 38 --angle 1 -c 1 -o "O:\vlc-record-2013-01-17-.ts--38.m4v"  -f mp4  -w 1920 --loose-anamorphic  --modulus 2 -e x264 -b 1500 --vfr -a 1,2 -E faac,faac -6 dpl2,dpl2 -R Auto,48 -B 160,160 -D 0,0 --gain 0,0 --audio-fallback ffac3 --subtitle scan,1 --markers="C:\Users\ZZZZ\AppData\Local\Temp\O:\vlc-record-2013-01-17-.ts--38-38-chapters.csv" --x264-preset=veryfast  --x264-profile=main  --h264-level="4.0"  --verbose=1
User Query: False

[15:42:38] hb_init: starting libhb thread
HandBrake 0.9.9 (2013052900) - MinGW x86_64 - http://handbrake.fr
4 CPUs detected
Opening O:\vlc-record-2013-01-17-.ts...
[15:42:38] hb_scan: path=O:\vlc-record-2013-01-17-.ts, title_index=38
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening O:\vlc-record-2013-01-17-.ts/BDMV/index.bdmv
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening O:\vlc-record-2013-01-17-.ts/BDMV/BACKUP/index.bdmv
libbluray/bluray.c:1725: nav_get_title_list(O:\vlc-record-2013-01-17-.ts) failed (000000000033F450)
[15:42:38] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 4.1.3
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[15:42:38] dvd: not a dvd - trying as a stream/file instead
[15:42:38] file is MPEG Transport Stream with 188 byte packets offset 0 bytes
[15:42:38] Found the following PIDS
[15:42:38]     Video PIDS : 
[15:42:38]       0x809 type MPEG2 (0x2) (PCR)
[15:42:38]     Audio PIDS : 
[15:42:38]       0x808 type AC3 (0x81)
[15:42:38]       0x81b type AC3 (0x81)
[15:42:38]     Subtitle PIDS : 
[15:42:38]     Other PIDS : 
[15:42:38] stream id 0x808 (type 0x81 substream 0x0) audio 0x808
[15:42:38] stream id 0x81b (type 0x81 substream 0x0) audio 0x81b
[15:42:40] scan: decoding previews for title 1
Scanning title 1 of 1, preview 1, 10.00 %[15:42:40] scan: audio 0x808: AC-3, rate=48000Hz, bitrate=384000 English (AC3) (5.1 ch)
[15:42:40] scan: audio 0x81b: AC-3, rate=48000Hz, bitrate=192000 Espanol (AC3) (1.0 ch)
Scanning title 1 of 1, preview 1, 10.00 %
Scanning title 1 of 1, preview 2, 20.00 %
Scanning title 1 of 1, preview 2, 20.00 %
Scanning title 1 of 1, preview 3, 30.00 %
Scanning title 1 of 1, preview 3, 30.00 %
Scanning title 1 of 1, preview 4, 40.00 %
Scanning title 1 of 1, preview 4, 40.00 %
Scanning title 1 of 1, preview 5, 50.00 %
Scanning title 1 of 1, preview 6, 60.00 %
Scanning title 1 of 1, preview 7, 70.00 %
Scanning title 1 of 1, preview 8, 80.00 %
Scanning title 1 of 1, preview 9, 90.00 %
Scanning title 1 of 1, preview 10, 100.00 %[15:42:42] scan: 10 previews, 1920x1080, 29.970 fps, autocrop = 2/0/0/4, aspect 16:9, PAR 1:1
[15:42:42] stream: 50 good frames, 0 errors (0%)
[15:42:42] libhb: scan thread found 1 valid title(s)
+ title 1:
  + stream: O:\vlc-record-2013-01-17-.ts
  + duration: 00:01:04
  + size: 1920x1080, pixel aspect: 1/1, display aspect: 1.78, 29.970 fps
  + autocrop: 2/0/0/4
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 00:01:04
  + audio tracks:
    + 1, English (AC3) (5.1 ch) (iso639-2: eng), 48000Hz, 384000bps
    + 2, Espanol (AC3) (1.0 ch) (iso639-2: spa), 48000Hz, 192000bps
  + subtitle tracks:
    + 1, Closed Captions (iso639-2: eng) (Text)(CC)
Reading chapter markers from file C:\Users\ZZZZ\AppData\Local\Temp\vlc-record-2013-01-17-.ts--38-38-chapters.csv
Subtitle Scan Enabled - enabling subtitles if found for foreign language segments
[15:42:42] 2 job(s) to process
[15:42:42] starting job
[15:42:42] sync: expecting 1946 video frames
[15:42:42] work: only 1 chapter, disabling chapter markers
[15:42:42] job configuration:
[15:42:42]  * source
[15:42:42]    + O:\vlc-record-2013-01-17-.ts
[15:42:42]    + title 1, chapter(s) 1 to 1
[15:42:42]  * destination
[15:42:42]    + O:\vlc-record-2013-01-17-.ts--38.m4v
[15:42:42]    + container: MPEG-4 (.mp4 and .m4v)
[15:42:42]  * video track
[15:42:42]    + decoder: mpeg2
[15:42:42]      + bitrate 20000 kbps
[15:42:42]    + frame rate: same as source (around 29.970 fps)
[15:42:42]    + filters
[15:42:42]      + Framerate Shaper (0:27000000:900900)
[15:42:42]        + frame rate: same as source (around 29.970 fps)
[15:42:42]      + Crop and Scale (1920:1080:2:0:0:4)
[15:42:42]        + source: 1920 * 1080, crop (2/0/0/4): 1916 * 1078, scale: 1920 * 1080
[15:42:42]    + loose anamorphic
[15:42:42]      + storage dimensions: 1920 * 1080, mod 2
[15:42:42]      + pixel aspect ratio: 4311 / 4312
[15:42:42]      + display dimensions: 1919 * 1080
[15:42:42]  * Foreign Audio Search: Passthrough
[15:42:42] file is MPEG Transport Stream with 188 byte packets offset 0 bytes
[15:42:43] stream: error near frame 449: continuity error: got 15 expected 8
[15:42:44] hb_ts_stream_decode - eof
[15:42:44] reader: done. 9 scr changes
[15:42:44] work: average encoding speed for job is 0.000000 fps
[15:42:44] render: lost time: 0 (0 frames)
[15:42:44] render: gained time: 0 (0 frames) (0 not accounted for)
[15:42:44] mpeg2 done: 0 frames
[15:42:44] stream: 1924 good frames, 19 errors (1%)
[15:42:44] No candidate detected during subtitle scan
[15:42:44] starting job
[15:42:44] work: sanitizing track 2 mixdown Dolby Pro Logic II to Mono
[15:42:44] sync: expecting 1946 video frames
[15:42:44] work: only 1 chapter, disabling chapter markers
[15:42:44] job configuration:
[15:42:44]  * source
[15:42:44]    + O:\vlc-record-2013-01-17-.ts
[15:42:44]    + title 1, chapter(s) 1 to 1
[15:42:44]  * destination
[15:42:44]    + O:\vlc-record-2013-01-17-.ts--38.m4v
[15:42:44]    + container: MPEG-4 (.mp4 and .m4v)
[15:42:44]  * video track
[15:42:44]    + decoder: mpeg2
[15:42:44]      + bitrate 20000 kbps
[15:42:44]    + frame rate: same as source (around 29.970 fps)
[15:42:44]    + filters
[15:42:44]      + Framerate Shaper (0:27000000:900900)
[15:42:44]        + frame rate: same as source (around 29.970 fps)
[15:42:44]      + Crop and Scale (1920:1080:2:0:0:4)
[15:42:44]        + source: 1920 * 1080, crop (2/0/0/4): 1916 * 1078, scale: 1920 * 1080
[15:42:44]    + loose anamorphic
[15:42:44]      + storage dimensions: 1920 * 1080, mod 2
[15:42:44]      + pixel aspect ratio: 4311 / 4312
[15:42:44]      + display dimensions: 1919 * 1080
[15:42:44]    + encoder: H.264 (x264)
[15:42:44]      + x264 preset: veryfast
[15:42:44]      + h264 profile: main
[15:42:44]      + h264 level: 4.0
[15:42:44]      + bitrate: 1500 kbps, pass: 0
[15:42:44]  * subtitle track 1, Closed Captions (track 0, id 0x0) Text [CC] -> Passthrough
[15:42:44]  * audio track 1
[15:42:44]    + decoder: English (AC3) (5.1 ch) (track 1, id 0x808)
[15:42:44]      + bitrate: 384 kbps, samplerate: 48000 Hz
[15:42:44]    + mixdown: Dolby Pro Logic II
[15:42:44]    + encoder: AAC (faac)
[15:42:44]      + bitrate: 160 kbps, samplerate: 48000 Hz
[15:42:44]  * audio track 2
[15:42:44]    + decoder: Espanol (AC3) (1.0 ch) (track 2, id 0x81b)
[15:42:44]      + bitrate: 192 kbps, samplerate: 48000 Hz
[15:42:44]    + mixdown: Mono
[15:42:44]    + encoder: AAC (faac)
[15:42:44]      + bitrate: 160 kbps, samplerate: 48000 Hz
[15:42:44] file is MPEG Transport Stream with 188 byte packets offset 0 bytes
[15:42:44] encx264: min-keyint: 30, keyint: 300
[15:42:44] reader: first SCR 6710874645 id 0x809 DTS 6710910659
[15:42:44] encx264: encoding with stored aspect 4311/4312
x264 [warning]: --psnr used with psy on: results will be invalid!
x264 [warning]: --tune psnr should be used if attempting to benchmark psnr!
x264 [info]: using SAR=4311/4312
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64 SlowShuffle
x264 [info]: profile Main, level 4.0
[15:42:44] sync: adding 95 ms of silence to audio 0x81b  start 8561, next 0
[15:42:44] sync: audio 0x808 time went backwards 82 ms, dropped 3 frames (start 1190, next 8640)
[15:42:44] mpeg2: "Chapter 1" (1) at frame 0 time 141141
[15:42:44] sync: first pts is 141141

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Mon Aug 18, 2014 8:15 pm

Is there any progress on fixing this serious Bug ?
If the developers are having difficulty finding this Bug, then implement a workaround
in which a timer is set on progress through the file as measured by the percentage in
the extreme left bottom of the window --
if no change after 30 seconds, then
1) terminate the conversion,
2) enter the pathname of the hanging file in a file-based Log,
3) either a) retry the same file and continue the batch sequence, or
b) continue the batch sequence with the next file in sequence.

The hanging pathname always will complete conversion when pulled out of the batch
and converted independently,
thus the Bug has something to do with the batch handling software.
The hang usually becomes stuck after around 4% of the file converted --
thus the hang is not occurring on startup but during the conversion.

Some batch conversion series will last for several Days, usually scheduled during
a time of non-use or limited use of the PC, thus it is critical
that everything be done to ensure that it runs to completion without hanging.

Hopefully, no future release of handbrake will occur without dealing this serious Bug,
one way or the other.

//Handbrake 0.9.9.5530 64-bit version//Windows 7 64//Q6600//Nvidia 670//12 GByte Sdram//

mduell
Veteran User
Posts: 6629
Joined: Sat Apr 21, 2007 8:54 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by mduell » Mon Aug 18, 2014 10:05 pm

Have you tried the nightly yet?

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Mon Aug 18, 2014 11:03 pm

mduell wrote:Have you tried the nightly yet?
Not yet.
I read the description of the Beta, and nothing in that description
dealt explicitly with this serious Bug.
And since this Bug has a global effect on a sequence of Conversions
(although the hanging file is usually an ATSC file),
I would have expected the Beta release documentation to address
this Bug explicitly.

mduell
Veteran User
Posts: 6629
Joined: Sat Apr 21, 2007 8:54 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by mduell » Mon Aug 18, 2014 11:25 pm

There's been hundreds of changes since 0.9.9, and some of them are actually updating third party libraries have have had hundreds of changes themselves. I wouldn't expect a bug like this to appear in the release highlights, notwithstanding your repeated overdramatization as a "serious Bug." You won't get any developer attention unless you reproduce the problem with the nightlies or at least 0.10b1.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Mon Aug 18, 2014 11:49 pm

mduell wrote:There's been hundreds of changes since 0.9.9, and some of them are actually updating third party libraries have have had hundreds of changes themselves. I wouldn't expect a bug like this to appear in the release highlights, notwithstanding your repeated overdramatization as a "serious Bug." You won't get any developer attention unless you reproduce the problem with the nightlies or at least 0.10b1.
Over-dramatization ?
This Bug affects the overall general sequences of usages of the program.
Regardless of what someone is trying to perform with the program, if it is hung,
it will not be performed.
That is a showstopper Bug.

This program performs 2 features which are important and are hard to find elsewhere:
1) Closed Captions pass-through of many forms of Closed Captions,
(notably absent from this is Windows Media Center (WMC) .wtv file Closed Captions
and I am not aware if the previously reported SCTE-20 Closed Captions failure was fixed), and

2) batch series of conversions, which allow the consumption of the PC CPU throughput
which conversions demand be scheduled at times when the user may not be using the PC
(of course, those users who have not figured out the arcane method to set up a
batch of conversions might have a hard time exploiting this feature).

I am downloading the Beta today, but I no longer have a long sequence to convert.
On average this hangs on maybe 1 in 20 conversions (around 60% of which are ATSC)
in the version I documented.
It can take hours to reach the hang.
As mentioned, at least a hang recovery timer-terminate-continue with a Log
of the pathnames of hanging files, should be implemented,
whether you think you have fixed this Bug or not.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 6:06 am

Batch Hang Bug definitely Not fixed in the Beta.
This time hung at 98.72% of the 20th conversion file after around 2 hours of conversions
(pathnames edited).
It is easy for a project administrator of a program like this to become distracted
by all the paid advertising shills who hang out on forums like this all day.
This project should focus on its core mission (and its special sauce, i.e. Closed Captions and Batch)
first, before diverging onto whatever nonsense is being pitched.
Strangely, Frames Per Seconds may have been slower, with this new GPU feature turned on
(Nvidia CUDA) -- conversion speed is important and is definitely part of the mission.

As recommended, implement a timer-terminate-retry-continue-to-next-conversion-log
workaround, then the Bug's effects will not be as catastrophic.
(Of course, this would not be catastrophic to a paid advertising shill
who does not really use this program).

Code: Select all

HandBrake svn6306 (Nightly Build) - 64bit Version
OS: Microsoft Windows NT 6.1.7601 Service Pack 1
CPU: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
Ram: 12286 MB, 
GPU Information:
  NVIDIA GeForce GTX 670 - 9.18.13.4052
Screen: 1920x1200
Temp Dir: C:\AppData\Local\Temp\
Install Dir: C:\Program Files\Handbrake
Data Dir: C:\AppData\Roaming\HandBrake\HandBrake\0.0.0.6306

-------------------------------------------
CLI Query:  -i "O:\vlc-record-2014-03-.ts" -t 20 --angle 1 -c 1 -o "C:\vlc-

record-2014-03-.m4v"  -f mp4  -w 1920 --crop 2:0:0:4 --loose-anamorphic  --modulus 

2 -e x264 -b 1200 --vfr -a 1 -E av_aac -6 dpl2 -R Auto -B 160 -D 0 --gain 0 --

audio-fallback ac3 --markers="C:\AppData\Local\Temp\vlc-record-2014-03-.csv" --

encoder-preset=veryfast  --encoder-level="4.0"  --encoder-profile=main  --

verbose=1 -U 

[21:32:17] hb_init: starting libhb thread
HandBrake svn6306 (2014081801) - MinGW x86_64 - http://handbrake.fr
4 CPUs detected
Opening O:\vlc-record-2014-03-.ts...
[21:32:17] CPU: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
[21:32:17]  - logical processor count: 4
[21:32:17] OpenCL device #1: NVIDIA Corporation GeForce GTX 670
[21:32:17]  - OpenCL version: 1.1 CUDA
[21:32:17]  - driver version: 340.52
[21:32:17]  - device type:    GPU
[21:32:17]  - supported:      no
[21:32:17] Intel Quick Sync Video support: no
[21:32:17] hb_scan: path=O:\vlc-record-2014-03-.ts, title_index=20
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening O:\vlc-record-2014

-03-.ts/BDMV/index.bdmv
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening O:\vlc-record-2014

-03-.ts/BDMV/BACKUP/index.bdmv
libbluray/bluray.c:2182: nav_get_title_list(O:\vlc-record-2014-03-.ts) failed
[21:32:17] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 5.0.0
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[21:32:17] dvd: not a dvd - trying as a stream/file instead
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000021fdfa0] Invalid frame dimensions 0x0.
Input #0, mpegts, from 'O:\vlc-record-2014-03-.ts':
  Duration: 00:00:54.74, start: 7667.080067, bitrate: 15624 kb/s
  Program 4 
    Stream #0.0[0x809]: Video: mpeg2video (Main), yuv420p, 1920x1080 [PAR 1:1 DAR 

16:9], 20000 kb/s, 29.97 fps, 90k tbn, 59.94 tbc
    Stream #0.1[0x808](eng): Audio: ac3, 48000 Hz, 5.1, fltp, 384 kb/s
    Stream #0.2[0x81b](spa): Audio: ac3, 48000 Hz, mono, fltp, 192 kb/s
[21:32:18] scan: decoding previews for title 1
Scanning title 1 of 1, preview 1, 10.00 %[21:32:18] scan: audio 0x1: ac3, 

rate=48000Hz, bitrate=384000 English (AC3) (5.1 ch)
[21:32:18] scan: audio 0x2: ac3, rate=48000Hz, bitrate=192000 Espanol (AC3) (1.0 

ch)
Scanning title 1 of 1, preview 3, 30.00 %
Scanning title 1 of 1, preview 4, 40.00 %
Scanning title 1 of 1, preview 5, 50.00 %
Scanning title 1 of 1, preview 7, 70.00 %
Scanning title 1 of 1, preview 8, 80.00 %
Scanning title 1 of 1, preview 10, 100.00 %[21:32:19] scan: 10 previews, 

1920x1080, 29.970 fps, autocrop = 2/0/0/4, aspect 16:9, PAR 1:1
[21:32:19] libhb: scan thread found 1 valid title(s)
+ title 1:
  + stream: O:\vlc-record-2014-03-06-.ts
  + duration: 00:00:54
  + size: 1920x1080, pixel aspect: 1/1, display aspect: 1.78, 29.970 fps
  + autocrop: 2/0/0/4
  + support opencl: no
  + support hwd: yes
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 00:00:54
  + audio tracks:
    + 1, English (AC3) (5.1 ch) (iso639-2: eng), 48000Hz, 384000bps
    + 2, Espanol (AC3) (1.0 ch) (iso639-2: spa), 48000Hz, 192000bps
  + subtitle tracks:
    + 1, Closed Captions (iso639-2: eng) (Text)(CC)
Reading chapter markers from file C:\AppData\Local\Temp\vlc-record-2014-03-.ts--

20__8-20-2014-20-chapters.csv
[21:32:19] 1 job(s) to process
[21:32:19] starting job
[21:32:19] sync: expecting 1640 video frames
[21:32:19] work: only 1 chapter, disabling chapter markers
[21:32:19] job configuration:
[21:32:19]  * source
[21:32:19]    + O:\vlc-record-2014-03-.ts
[21:32:19]    + title 1, chapter(s) 1 to 1
[21:32:19]    + container: mpegts
[21:32:19]    + data rate: 15624 kbps
[21:32:19]  * destination
[21:32:19]    + C:\vlc-record-2014-03-.m4v
[21:32:19]    + container: MPEG-4 (libavformat)
[21:32:19]  * video track
[21:32:19]    + decoder: mpeg2video
[21:32:19]      + bitrate 20000 kbps
[21:32:19]    + filters
[21:32:19]      + Framerate Shaper (0:27000000:900900)
[21:32:19]        + frame rate: same as source (around 29.970 fps)
[21:32:19]      + Crop and Scale (1920:1080:2:0:0:4)
[21:32:19]        + source: 1920 * 1080, crop (2/0/0/4): 1916 * 1078, scale: 1920 

* 1080
[21:32:19]    + loose anamorphic
[21:32:19]      + storage dimensions: 1920 * 1080, mod 2
[21:32:19]      + pixel aspect ratio: 4311 / 4312
[21:32:19]      + display dimensions: 1919 * 1080
[21:32:19]    + encoder: H.264 (libx264)
[21:32:19]      + preset:  veryfast
[21:32:19]      + profile: main
[21:32:19]      + level:   4.0
[21:32:19]      + bitrate: 1200 kbps, pass: 0
[21:32:19]  * audio track 1
[21:32:19]    + decoder: English (AC3) (5.1 ch) (track 1, id 0x1)
[21:32:19]      + bitrate: 384 kbps, samplerate: 48000 Hz
[21:32:19]    + mixdown: Dolby Pro Logic II
[21:32:19]    + encoder: AAC (libavcodec)
[21:32:19]      + bitrate: 160 kbps, samplerate: 48000 Hz
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[mpeg2video @ 00000000022b7620] Invalid frame dimensions 0x0.
[21:32:19] reader: first SCR 690080996 id 0x0 DTS 690071987
[21:32:19] encx264: min-keyint: 30, keyint: 300
[21:32:19] encx264: encoding at average bitrate 1200
[21:32:19] encx264: unparsed options: 

level=4.0:ref=1:8x8dct=0:weightp=1:subme=2:mixed-refs=0:trellis=0:vbv-

bufsize=25000:vbv-maxrate=20000:rc-lookahead=10
x264 [info]: using SAR=4311/4312
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64 SlowShuffle
x264 [info]: profile Main, level 4.0
[21:33:33] reader: done. 1 scr changes

User avatar
s55
HandBrake Team
Posts: 9522
Joined: Sun Dec 24, 2006 1:05 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by s55 » Thu Aug 21, 2014 3:32 pm

This isn't necessarily a bug.
Recorded ts files really need to be pre-processed first before running them though HandBrake. HandBrake is not a ts repair tool, so if your ts file has any errors/corruption in it, it'll cause problems. From the log above, it looks like your file has problems.

TsDoctor is one example of a tool that is designed for this purpose.

If you can provide a sample that re-creates it, we can take a look see if there are any workarounds, otherwise there is nothing more we can do about it.

vid.user
Posts: 28
Joined: Tue Dec 18, 2012 9:36 am

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by vid.user » Thu Aug 21, 2014 4:34 pm

I'm sure the OP is my ex-GF in disguise..... :lol:

User avatar
JohnAStebbins
HandBrake Team
Posts: 5440
Joined: Sat Feb 09, 2008 7:21 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by JohnAStebbins » Thu Aug 21, 2014 4:45 pm

Sorry you are having this problem. But I've never seen such a "hang" issue and I don't recall any similar reports of hanging.

The last log you posted appears fragmented and incomplete, but the final line indicates that an encodeing job completed.

Code: Select all

[21:33:33] reader: done. 1 scr changes
There should be more logs after that message with additional statistics about the encode. But since the log you posted is broken, I really cant determine if it was handbrake that hung at exactly this point, or if whatever corrupted your log caused this missing output.

This log you provided for the nightly indicates that the encoding process got much further (essentially finishes) than your log from the releases. Your release log indicates it hangs very early in the encode. So I'm not convenced that we are even looking at the same issue in the nightlies as you see in the release.

User avatar
JohnAStebbins
HandBrake Team
Posts: 5440
Joined: Sat Feb 09, 2008 7:21 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by JohnAStebbins » Thu Aug 21, 2014 4:55 pm

Aeneas wrote: This project should focus on its core mission (and its special sauce, i.e. Closed Captions and Batch)
first, before diverging onto whatever nonsense is being pitched.
This project has *no* "core mission". It is a hobby that has attracted a small number of developers who work on whatever interests them.

We would of coarse like HandBrake to work as expected and we do make an effort to fix bugs as we find them. But your bug is not reproducable by anyone. So it leaves us with no way to make progress on it.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 6:17 pm

s55 wrote:This isn't necessarily a bug.
Recorded ts files really need to be pre-processed first before running them though HandBrake. HandBrake is not a ts repair tool, so if your ts file has any errors/corruption in it, it'll cause problems. From the log above, it looks like your file has problems.

TsDoctor is one example of a tool that is designed for this purpose.

If you can provide a sample that re-creates it, we can take a look see if there are any workarounds, otherwise there is nothing more we can do about it.
As I have mentioned, the same hanging file, when pulled out of the sequence,
will convert to completion.
Thus, the inherent file structure and possible discontinuities in the data
are not causing this Hang.
I have never had a hang when using this program in non-batch mode.

I have already recommended a simple Timer-Terminate workaround which should trigger when
no progress is being made through the file.

As I have mentioned, it is likely that few other users are using this Batch feature because
it is hard to figure out how to use and poorly documented.
Who knows, maybe some of the developers and QA people on this project have
not figured out the batch configure sequence.

Continuing the Batch to the next manually, I had later on another Hang, at 99.49%.
The fact that these Hangs are happening late seems to be a difference in this Beta.
Attaching the debugger to this Hang-ed HandbrakeCLI.exe, this is the data visible:

========================================================================
> HandBrakeCLI.exe!0000000000d7847b()
[Frames below may be incorrect and/or missing, no symbols loaded for HandBrakeCLI.exe]
HandBrakeCLI.exe!0000000000d79168()
HandBrakeCLI.exe!0000000000d79b9e()
HandBrakeCLI.exe!000000000050d190()
HandBrakeCLI.exe!000000000050cfaf()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()
============================================================

RAX = 0000000000000B34 RBX = 000000001361AA33 RCX = 0000000000000541 RDX = 0000000000000540 RSI = 0000000004F5C1C0 RDI = 0000000000000006 R8  = 000000001FBD7308 R9  = 0000000000000000 R10 = 000000000000001C R11 = 00000000FFFFFFD9

R12 = 0000000004B32BF0 R13 = 0000000004B30238 R14 = 000000000000007F R15 = 0000000000000026 RIP = 0000000000D7847B RSP = 000000000674FBF0 RBP = 0000000001D8B1A0 EFL = 00000203

=================================================================
0000000000D78432 test eax,eax
0000000000D78434 jns 0000000000D784B1
0000000000D78436 jmp 0000000000D785AD
0000000000D7843B nop dword ptr [rax+rax]
0000000000D78440 add r10d,r15d
0000000000D78443 cmp r10d,3Fh
0000000000D78447 jg 0000000000D766DB
0000000000D7844D movsxd rax,r10d
0000000000D78450 add ecx,1
0000000000D78453 movzx r9d,byte ptr [r13+rax]
0000000000D78459 lea eax,[r14+r14+1]
0000000000D7845E imul eax,edi
0000000000D78461 movzx r15d,r9b
0000000000D78465 movzx r9d,word ptr [r12+r9*2]
0000000000D7846A imul eax,r9d
0000000000D7846E mov r9d,r8d
0000000000D78471 add r8d,r8d
0000000000D78474 sar r9d,0FFh
0000000000D78478 sar eax,5
==>>0000000000D7847B xor eax,r9d
0000000000D7847E sub eax,r9d
0000000000D78481 cmp ecx,edx
0000000000D78483 cmova ecx,edx
0000000000D78486 mov r9d,ecx
0000000000D78489 xor r11d,eax
0000000000D7848C cmp r8d,0C0000000h
0000000000D78493 mov word ptr [rsi+r15*2],ax
0000000000D78498 jl 0000000000D785F0
0000000000D7849E mov eax,r9d
0000000000D784A1 mov ecx,r9d
0000000000D784A4 shr eax,3
0000000000D784A7 and ecx,7
0000000000D784AA mov eax,dword ptr [rbx+rax]
0000000000D784AD bswap eax
0000000000D784AF shl eax,cl
0000000000D784B1 mov ecx,eax
0000000000D784B3 shr ecx,0F7h
0000000000D784B6 mov ecx,ecx
0000000000D784B8 lea r8,[rbp+rcx*4]
0000000000D784BD movsx ecx,byte ptr [r8+2]
0000000000D784C2 movsx r14d,word ptr [r8]
0000000000D784C6 test ecx,ecx
0000000000D784C8 js 0000000000D78560
0000000000D784CE shl eax,cl
0000000000D784D0 add ecx,r9d
0000000000D784D3 movzx r15d,byte ptr [r8+3]
0000000000D784D8 cmp ecx,edx
0000000000D784DA mov r8d,eax
===========================================================================
Unflagged > 23272 0 Worker Thread Win64 Thread 0000000000d7847b Normal
Unflagged 26296 0 Main Thread Main Thread 00000000778715fa Normal
Unflagged 11844 0 Worker Thread Win64 Thread 00000000778715fa Normal
Unflagged 12796 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 4188 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 23876 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 27636 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 23480 0 Worker Thread Win64 Thread 0000000077872baa Normal
Unflagged 26520 0 Worker Thread Win64 Thread 0000000077872baa Normal
Unflagged 1636 0 Worker Thread Win64 Thread 0000000077872baa Normal
Unflagged 27288 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 13544 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 11876 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 14228 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 22696 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 15256 0 Worker Thread Win64 Thread 000000007787186a Lowest
Unflagged 14556 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 13700 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 19340 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 25920 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 19556 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 3344 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 7780 0 Worker Thread Win64 Thread 000000007787186a Normal
Unflagged 13016 0 Worker Thread Win64 Thread 000000007787186a Normal

============================================================================================

Unflagged 26296 0 Main Thread Main Thread 00000000778715fa Normal
ntdll.dll!00000000778715fa()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801203()
HandBrakeCLI.exe!0000000001319af5()
HandBrakeCLI.exe!00000000004013e5()
HandBrakeCLI.exe!0000000000401508()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 11844 0 Worker Thread Win64 Thread 00000000778715fa Normal
ntdll.dll!00000000778715fa()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801203()
HandBrakeCLI.exe!0000000000412276()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 12796 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!000000000045c466()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 4188 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!0000000000459a16()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 23876 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!0000000000459a16()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 27636 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!0000000000459999()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged > 23272 0 Worker Thread Win64 Thread 0000000000d7847b Normal
HandBrakeCLI.exe!0000000000d7847b()
[Frames below may be incorrect and/or missing, no symbols loaded for HandBrakeCLI.exe]
HandBrakeCLI.exe!0000000000d79168()
HandBrakeCLI.exe!0000000000d79b9e()
HandBrakeCLI.exe!000000000050d190()
HandBrakeCLI.exe!000000000050cfaf()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 23480 0 Worker Thread Win64 Thread 0000000077872baa Normal
ntdll.dll!0000000077872baa()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
ntdll.dll!00000000778e4ed4()
kernel32.dll!000000007764b608()
HandBrakeCLI.exe!000000000050cfe4()
HandBrakeCLI.exe!000000000050d128()
HandBrakeCLI.exe!000000000050cfaf()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 26520 0 Worker Thread Win64 Thread 0000000077872baa Normal
ntdll.dll!0000000077872baa()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
ntdll.dll!00000000778e4ed4()
kernel32.dll!000000007764b608()
HandBrakeCLI.exe!000000000050cfe4()
HandBrakeCLI.exe!000000000050d128()
HandBrakeCLI.exe!000000000050cfaf()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 1636 0 Worker Thread Win64 Thread 0000000077872baa Normal
ntdll.dll!0000000077872baa()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
ntdll.dll!00000000778e4ed4()
kernel32.dll!000000007764b608()
HandBrakeCLI.exe!000000000050cfe4()
HandBrakeCLI.exe!000000000050d51f()
HandBrakeCLI.exe!0000000000d7c3d9()
HandBrakeCLI.exe!0000000000d7d0e9()
HandBrakeCLI.exe!00000000004a4dcb()
HandBrakeCLI.exe!000000000043bcf5()
HandBrakeCLI.exe!000000000043c86d()
HandBrakeCLI.exe!000000000043cd95()
HandBrakeCLI.exe!00000000004598d1()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 27288 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 13544 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 11876 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 14228 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 22696 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 15256 0 Worker Thread Win64 Thread 000000007787186a Lowest
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 14556 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 13700 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!000000000079de2b()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 19340 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9625e()
HandBrakeCLI.exe!00000000007b926f()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 25920 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!00000000004598a4()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 19556 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!0000000000459999()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 3344 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!0000000000459999()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 7780 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!00000000004598a4()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()

Unflagged 13016 0 Worker Thread Win64 Thread 000000007787186a Normal
ntdll.dll!000000007787186a()
[Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll]
KernelBase.dll!000007fefd801430()
kernel32.dll!00000000776106e0()
HandBrakeCLI.exe!0000000000c9570e()
HandBrakeCLI.exe!0000000000c9650c()
HandBrakeCLI.exe!000000000040756c()
HandBrakeCLI.exe!0000000000433259()
HandBrakeCLI.exe!00000000004339ff()
HandBrakeCLI.exe!00000000004068af()
HandBrakeCLI.exe!0000000000c94d90()
msvcrt.dll!000007fefdbe415f()
msvcrt.dll!000007fefdbe6ebd()
kernel32.dll!00000000776159ed()
ntdll.dll!000000007784c541()
==================================================================================================
Last edited by Aeneas on Thu Aug 21, 2014 10:15 pm, edited 2 times in total.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 6:27 pm

JohnAStebbins wrote:
Aeneas wrote: This project should focus on its core mission (and its special sauce, i.e. Closed Captions and Batch)
first, before diverging onto whatever nonsense is being pitched.
This project has *no* "core mission". It is a hobby that has attracted a small number of developers who work on whatever interests them.

We would of course like HandBrake to work as expected and we do make an effort to fix bugs as we find them. But your bug is not reproducible by anyone. So it leaves us with no way to make progress on it.
This is the first I have heard that this Bug is not reproducible.
Is your QA process set up to perform long sequences of Batch conversions
overnight over several hours ?

User avatar
s55
HandBrake Team
Posts: 9522
Joined: Sun Dec 24, 2006 1:05 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by s55 » Thu Aug 21, 2014 6:29 pm

HandBrakeCLI.exe does not support batches. Each encode is a new process so "batching" is not the source of the problem.
Also note that HandBrakeCLI.exe is not compiled with symbols, so useful debugging is not possible.

Without a sample that reproduces the problem, there is nothing we can do to investigate it.

User avatar
JohnAStebbins
HandBrake Team
Posts: 5440
Joined: Sat Feb 09, 2008 7:21 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by JohnAStebbins » Thu Aug 21, 2014 6:39 pm

My "QA process" is to stack up a directory full of collected samples that are known to have caused problems in the past, load them into the queue, let it run to completion and scan the logs produced for any unusual and obvious changes in behavior.

I can't speak for how the other developers test things. I only run such tests on the linux gui since that is the platform I develope for.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 6:41 pm

s55 wrote:HandBrakeCLI.exe does not support batches. Each encode is a new process so "batching" is not the source of the problem.
Also note that HandBrakeCLI.exe is not compiled with symbols, so useful debugging is not possible.

Without a sample that reproduces the problem, there is nothing we can do to investigate it.
The Debugger output that I produced does directly represent the program state when this Bug occurs.

What do you mean Handbrake does not support batches ?
Batches are clearly in the user interface of the program, though not well documented.
If you are saying that you provide the functionality "as is" that is a different statement.
Again, the workaround I have recommended is trivial for you to implement.
How hard is a Timer to implement in your code and perform a simple test on the
percentage in the left bottom corner of the Handbrake window ?
This is not a serious coding undertaking.
Every 30 seconds, check to see if the percentage has changed -- if not, terminate. Trivial.
Last edited by Aeneas on Thu Aug 21, 2014 6:50 pm, edited 1 time in total.

User avatar
s55
HandBrake Team
Posts: 9522
Joined: Sun Dec 24, 2006 1:05 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by s55 » Thu Aug 21, 2014 6:47 pm

Read what I said. "HandBrakeCLI.exe" (as in the command line interface) does not support batches. Since the Windows GUI calls a new instances of this for every new encode on the queue, it means it has nothing to do with the order of the queue that triggers this issue. This means another factor is contributing to the problem.

A timer is a hack, not a solution. Not going to happen.

dynaflash
Veteran User
Posts: 3820
Joined: Thu Nov 02, 2006 8:19 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by dynaflash » Thu Aug 21, 2014 6:54 pm

I notice none of your suggestions for what you deem to be a "trivial" fix is accompanied by a pastebinned patch. That said its not the right fix imo.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 6:57 pm

s55 wrote:Read what I said. "HandBrakeCLI.exe" (as in the command line interface) does not support batches. Since the Windows GUI calls a new instances of this for every new encode on the queue, it means it has nothing to do with the order of the queue that triggers this issue. This means another factor is contributing to the problem.
A timer is a hack, not a solution. Not going to happen.
If you cannot fix this catastrophic Bug, this Timer solution is all you have.
This is a showstopper Bug, in one of your 2 main features --
it has to be fixed one way or the other.

The appearance is that there are 2 programs operating in the Batch operation:
Handbrake and HandbrakeCLI. Handbrake.exe seems to be the supervisor which
spawns HandbrakeCLI.exe to actually perform each conversion.
If your point is to blame the Windows Kernel for this Hang, that is not the case.

User avatar
s55
HandBrake Team
Posts: 9522
Joined: Sun Dec 24, 2006 1:05 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by s55 » Thu Aug 21, 2014 7:18 pm

I never said anything regarding the windows kernel...

Fact is, you are the *only* person to report this problem, and have not provided sufficient data for us to investigate further or any kind of proof that the issue is not a factor external to HandBrake.

Unless you can provide a sample that reproduces this issue, I consider this topic closed.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 7:30 pm

s55 wrote:I never said anything regarding the windows kernel...

Fact is, you are the *only* person to report this problem, and have not provided sufficient data for us to investigate further or any kind of proof that the issue is not a factor external to HandBrake.

Unless you can provide a sample that reproduces this issue, I consider this topic closed.
Again, I have stated that the same file which causes the Hang, when pulled out of the Batch
and converted separately, will convert fine.
This either indicates that the Batch process is flawed, or maybe this is simply
a Hang which occurs on every roughly 20 independent conversions.
i.e. a random Bug which occurs unpredictably, which occurs in Batches
because that increases the number of opportunities for the Bug to occur.

Try documenting the Batching process better, and maybe more people
will report this failure.

Also, such a Timer is not a "hack" -- every serious piece of equipment, especially
something like a pacemaker or other medical device, has a Timer of this type,
not just implemented in software, but built into the hardware.
Practically, every microcontroller sold nowadays has some sort of Timer of this type built-in.
Last edited by Aeneas on Thu Aug 21, 2014 10:17 pm, edited 1 time in total.

User avatar
JohnAStebbins
HandBrake Team
Posts: 5440
Joined: Sat Feb 09, 2008 7:21 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by JohnAStebbins » Thu Aug 21, 2014 8:22 pm

Aeneas wrote: Again, I have stated that the same file which causes the Hang, when pulled out of the Batch
and converted separately, will convert fine.
This either indicates that the Batch process is flawed, or maybe this is simply
a Hang which occurs on every roughly 20 independent conversions.
...or it could be something unique to your environment (*very* likely since you are the only person to report this). Perhaps you have a failing hdd. Or if one of your drives is a network mapped drive perhaps a random network failure. There are dozens of things this could be that are not related to handbrake.

It might help to post both a log of a failure together with a log of the subsequent success when you retry encoding of the same source file. We might see a difference between the 2 logs that indicate the source of the problem.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 8:57 pm

JohnAStebbins wrote:
Aeneas wrote: Again, I have stated that the same file which causes the Hang, when pulled out of the Batch
and converted separately, will convert fine.
This either indicates that the Batch process is flawed, or maybe this is simply
a Hang which occurs on every roughly 20 independent conversions.
...or it could be something unique to your environment (*very* likely since you are the only person to report this). Perhaps you have a failing hdd. Or if one of your drives is a network mapped drive perhaps a random network failure. There are dozens of things this could be that are not related to handbrake.

It might help to post both a log of a failure together with a log of the subsequent success when you retry encoding of the same source file. We might see a difference between the 2 logs that indicate the source of the problem.
Nothing else in my system is hanging, and there are many large complex applications
which run reliably on this PC.

If you are having difficulty figuring out what is causing this problem, the normal response
from committed developers is to add debug code at various points where
operations are instigated.
Maybe pump that data into a circular buffer so that the most recent data would
be present to identify the cause of this Hang.

I notice there are 2 Log tabs -- encode and scan. What is the difference.
I notice right now that they are describing 2 different conversion source pathnames.
Last edited by Aeneas on Thu Aug 21, 2014 10:53 pm, edited 1 time in total.

Aeneas

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by Aeneas » Thu Aug 21, 2014 9:07 pm

JohnAStebbins wrote:Sorry you are having this problem. But I've never seen such a "hang" issue and I don't recall any similar reports of hanging.

The last log you posted appears fragmented and incomplete, but the final line indicates that an encodeing job completed.

Code: Select all

[21:33:33] reader: done. 1 scr changes
There should be more logs after that message with additional statistics about the encode. But since the log you posted is broken, I really cant determine if it was handbrake that hung at exactly this point, or if whatever corrupted your log caused this missing output.

This log you provided for the nightly indicates that the encoding process got much further (essentially finishes) than your log from the releases. Your release log indicates it hangs very early in the encode. So I'm not convenced that we are even looking at the same issue in the nightlies as you see in the release.
What appears fragmented or incomplete ?
As I stated, the pathnames are edited.

As I mentioned a few messages ago, the fact that the percentage is much later,
is different from the earlier hangs reported.
Thus, I was implying that the developers may have made progress on part of this problem.
I have only used this new Beta version for a few hours though, so far.

Finally, I would add that when these hangs occur, both before and in this Beta,
Windows Task Manager reports HandbrakeCLI.exe at a consistent 25% of this quad CPU --
usually,HanbrakeCLI.exe is up at 75%-80%, during healthy conversions.
Last edited by Aeneas on Thu Aug 21, 2014 11:02 pm, edited 1 time in total.

User avatar
JohnAStebbins
HandBrake Team
Posts: 5440
Joined: Sat Feb 09, 2008 7:21 pm

Re: Some batch conversions hang the sequence in 0.99 and 0.9

Post by JohnAStebbins » Thu Aug 21, 2014 9:54 pm

Look, I'm pretty much done with this thread. I will not be reading it again. At every turn, you are trying to tell us how we should debug or develop or support HandBrake. And frankly, I'm not interested in your opinions about this. As I already said, HandBrake is a hobby. When I gets too frustrating, I set it aside for a while. This thread has become frustrating, so I am setting it aside.

Locked