Unexpected Quit when converting M2TS to MKV (svn2592)

[happysin]

Ok, I am not sure if this is bug report-worthy yet, so I thought I'd start here.

I ripped the 12 Monkeys HD-DVD to M2TS using ClownBD. I then planned on converting that M2TS to an MKV. Well, about an hour into the encode, the console quit. and I don't see an error in the event log. I have no resultant file at all, and nothing that looks like an error. The last line in the log is about an hour before I saw it quit, and the whole time the console was making nice progress, until it just went away...

This is on Windows 7x64. Log is below.

Code: Select all

### Windows GUI svn2592 2009062101 
### Running: Microsoft Windows NT 6.1.7100.0 
###
### CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 3800+ 
### Ram: 4094 MB 
### Screen: 1920x1200 
### Temp Dir: C:\Users\Wayne\AppData\Local\Temp\ 
### Install Dir: C:\Program Files (x86)\Handbrake 
### Data Dir: C:\Users\Wayne\AppData\Roaming\HandBrake\HandBrake\0.9.3.5 
#########################################

### CLI Query:  -i "C:\Users\Wayne\Desktop\Demux.M2TS" -t 1 -c 1 -o "C:\Users\Wayne\Desktop\Demux-1.mkv" -f mkv -w 1920 --loose-anamorphic  --detelecine --decomb -e x264 -S 5000 -2  -T  -a 1,1 -E faac,ac3 -6 dpl2,auto -R 48,Auto -B 160,auto -D 0.0,0.0 --markers="C:\Users\Wayne\AppData\Local\Temp\Demux-1-1-chapters.csv" -x ref=3:mixed-refs=1:bframes=3:weightb=1:b-pyramid=1:b-adapt=2:me=umh:subq=9:analyse=all:8x8dct=1 -v 1

#########################################

[18:32:24] hb_init: checking cpu count
[18:32:24] hb_init: starting libhb thread
HandBrake svn2592 (2009062101) - MinGW i386 - http://handbrake.fr
2 CPUs detected
Opening C:\Users\Wayne\Desktop\Demux.M2TS...
[18:32:24] hb_scan: path=C:\Users\Wayne\Desktop\Demux.M2TS, title_index=1
[18:32:24] scan: trying to open with libdvdread
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
ERROR: dvd: ifoOpen failed
[18:32:24] file is MPEG Transport Stream with 192 byte packets offset 4 bytes
[18:32:24] hb_ts_stream_find_pids - found the following PIDS
[18:32:24]     Video PIDS : 
[18:32:24]       0x1011 type VC1 (0xea)
[18:32:24]     Audio PIDS : 
[18:32:24]       0x1100 type AC-3 (0x81)
[18:32:24] transport stream pid 0x1100 (type 0x81) may be AC-3 audio (id 0x1)
[18:32:24] scan: decoding previews for title 1
[18:32:24] scan: audio 0x1: AC-3, rate=48000Hz, bitrate=640000 English (AC3) (5.1 ch)
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
Scanning title 1...
[18:32:26] scan: 10 previews, 1920x1080, 23.976 fps, autocrop = 20/20/2/0, aspect 16:9, PAR 1:1
[18:32:26] scan: title (0) job->width:1920, job->height:1040
[18:32:26] stream: 6 good frames, 0 errors (0%)
[18:32:27] libhb: scan thread found 1 valid title(s)
+ title 1:
  + vts 0, ttn 0, cells 0->0 (0 blocks)
  + duration: 01:35:04
  + size: 1920x1080, pixel aspect: 1/1, display aspect: 1.78, 23.976 fps
  + autocrop: 20/20/2/0
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 01:35:04
  + audio tracks:
    + 1, English (AC3) (5.1 ch), 48000Hz, 640000bps
  + subtitle tracks:
Reading chapter markers from file C:\Users\Wayne\AppData\Local\Temp\Demux-1-1-chapters.csv
Invalid sample rate 0, using input rate 48000
Calculated bitrate: 6547 kbps
Modified x264 options for pass 1 to append turbo options: ref=3:mixed-refs=1:bframes=3:weightb=1:b-pyramid=1:b-adapt=2:me=umh:subq=9:analyse=all:8x8dct=1:ref=1:subme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[18:32:27] 2 job(s) to process
[18:32:27] starting job
[18:32:27] job configuration:
[18:32:27]  * source
[18:32:27]    + C:\Users\Wayne\Desktop\Demux.M2TS
[18:32:27]    + title 1, chapter(s) 1 to 1
[18:32:27]  * destination
[18:32:27]    + C:\Users\Wayne\Desktop\Demux-1.mkv
[18:32:27]    + container: Matroska (.mkv)
[18:32:27]      + chapter markers
[18:32:27]  * video track
[18:32:27]    + decoder: vc1
[18:32:27]      + bitrate 200 kbps
[18:32:27]    + frame rate: same as source (around 23.976 fps)
[18:32:27]    + loose anamorphic
[18:32:27]      + modulus: 0
[18:32:27]      + storage dimensions: 1920 * 1080 -> 1920 * 1040, crop 20/20/2/0
[18:32:27]      + pixel aspect ratio: 959 / 960
[18:32:27]      + display dimensions: 1918 * 1040
[18:32:27]    + filters
[18:32:27]      + Detelecine (pullup) (default settings)
[18:32:27]      + Decomb (default settings)
[18:32:27]    + encoder: x264
[18:32:27]      + options: ref=3:mixed-refs=1:bframes=3:weightb=1:b-pyramid=1:b-adapt=2:me=umh:subq=9:analyse=all:8x8dct=1:ref=1:subme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[18:32:27]      + bitrate: 6547 kbps, pass: 1
[18:32:27]  * audio track 0
[18:32:27]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[18:32:27]      + bitrate: 640 kbps, samplerate: 48000 Hz
[18:32:27]    + mixdown: Dolby Pro Logic II
[18:32:27]    + encoder: faac
[18:32:27]      + bitrate: 160 kbps, samplerate: 48000 Hz
[18:32:27]  * audio track 1
[18:32:27]    + decoder: English (AC3) (5.1 ch) (track 1, id 1)
[18:32:27]      + bitrate: 640 kbps, samplerate: 48000 Hz
[18:32:27]    + AC3 passthrough
libdvdread: Encrypted DVD support unavailable.
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdnav:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
ERROR: dvd: ifoOpen failed
[18:32:27] reader: first SCR 53955000
[18:32:27] yadif thread started for segment 0
[18:32:27] encx264: keyint-min: 24, keyint-max: 240
[18:32:27] encx264: encoding with stored aspect 959/960
x264 [info]: using SAR=959/960
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile Main, level 4.0
No accelerated IMDCT transform found
[18:32:27] yadif thread started for segment 1
[18:32:27] decomb thread started for segment 0
[18:32:27] decomb thread started for segment 1
No accelerated IMDCT transform found
[18:32:27] sync: expecting 136790 video frames
[18:32:27] sync: first pts is 3754

[JohnAStebbins]

Aside from the fact that you're using windows 7 everything looks pretty normal. But we have had reports from other w7 users of os instability. Not saying that's your issue. It could also be a poorly constructed m2ts. We've seen the decoder crash on bad m2ts files with vc1 video in other circumstances. If the original source was in multiple parts that ClownBD spliced together, you might try to see if it is crashing on one of the splice points. This is where I've run across crashes before. Improper splicing.

[happysin]

Hmm, interesting. As far as Win7 goes, I've done a few seasons of Futurama with the new Handbrake build with no issues, but that's just regular DVD rips, and much shorter encodes.

As far as ClownBD, it's entirely possible it's something there, I'll see if I can explore more avenues there, but I don't think specifically it's a splice issue. The file was split late in the movie, and I was barely 15% in when the quit happened.

Is there a way to turn on more verbose logging so I can retry it and see if I can replicate the issue? I have it running on a Windows Home Server as well to test, but the more info the better.

[JohnAStebbins]

I don't know if the windows gui has an option for it in the preferences, but there is a logging level that can be set. If it's not in the preferences, you'll have to use the query editor to change '-v 1' to '-v 2'

[happysin]

Cool, I'll be sure to add a logging level next time I try. I'm making another M2TS file of 12 Monkeys, as I think I made some settings mistakes the first time around.

Tangent, what's generally a good bitrate to re-encode HD DVD to make it playable on an Athlon X2 3800+? I tried setting to a fixed size of 5GB file size (so 1/3 full size), but whatever output I get stutters. I tried using the quality level slider as well, but I can't seem to find a good sweet spot between quality and performance.

Oh, the M2TS conversion on WHS failed as well, but left the first ten minutes as an actual video on the computer. So at least that time I got some results.

[JohnAStebbins]

Making the file smaller by compressing harder isn't going to make it any easier to decode. And it's going to create crappy quality. If you don't have any GPU acceleration for decode, you would be best off scaling the video down. 720p ought to be good enough (1280x720 max). This way you can keep all the quality you want. I highly recommend using a constant quality setting rather than ABR. 59% is a good quality level for HD. Unless you have disk space constraints, it's a better way. Also, since it is single pass, if you have a crash you should be left with a file that is playable up to the crash point.

[happysin]

Ah! Thanks for the clarification. I was trying to drop the bit-rate, thinking that would be the best method to not overtax the CPU. i'll try dropping to 720p.

[happysin]

Ok, first note, dropping to 720p worked like a champ as far as playback is concerned. Thanks for that!

That said, I tried adding verbose logging, but I don't think I did it right, as there were no extra logs in the Handbrake Logs folder, and the encode is still dropping at random times. So far I've had the resultant file be 90MB, 256MB, 1GB and no resultant file. They all quit at different times.

[JohnAStebbins]

Random you say. Hmmm. But I'm confused:

So far I've had the resultant file be 90MB, 256MB, 1GB and no resultant file

You say you have a file of a certain size and in the same breath say there is no file.

Random failures are very atypical. Sometimes that sort of thing can be caused by overheating or other external factors. Have you tried encoding the same file on a different machine?

[happysin]

I don't see what the confusion is, in 4 tests, the result were:

Test 1) 90MB file
Test 2) No file
Test 3) 1GB file
Test 4) 256MB file

So what I said does not contradict.

This is on two different machines, and both of them have no heat issues. I can also encode SD content all day long, it's only HD content. I've also tried two different HD sources (Blade Runner and 12 Monkeys)

[JohnAStebbins]

Sorry, I misread that. You didn't initially say there were 4 runs. And I read it as three runs where the resulting files sizes are ... *and* no resulting file. I.e. there are 3 files and there are no files.

The extra logging level only issues a few extra low level informative items. Our default logging level already has most everything that is of much interest. But you should see some difference.

Anyway, I run HD material through the linux version of hb all the time and haven't seen any crashes except the ones I've already referred to having to do with splicing. It's possible this is an issue with the windows version. If you can beg, borrow, or steal a mac or linux machine, it would be helpful to know if the problem is platform specific.

[happysin]

Ok, I'll see if I can grab a Mac next week from work.

I'll try converting HD DVDs to M2TS a few different ways this weekend as well, and see if it's a shortcoming in ClownBD configs.