[RESOLVED] [SVN 1866] MP4 error at > 2GB

Archive of historical bug reports.
Please use the GitHub link above to report issues.
Forum rules
*******************************
Please be aware we are now using GitHub for issue tracking and feature requests.
- This section of the forum is now closed to new topics.

*******************************
Post Reply
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

[RESOLVED] [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Hmm. Here's an odd error that occurred as my MP4 grew larger than 2gb using SVN 1866.

Code: Select all

Encoding: task 1 of 1, 57.92 % (5.03 fps, avg 7.25 fps, ETA 04h03m57s)Value too large for defined data type
ERROR: Failed to write to output file, disk full?
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
ERROR: Failed to write to output file, disk full?
[16:08:30] sync: got 146081 frames, 252204 expected
[16:08:30] reader: done. 1 scr changes
Muxing: this may take awhile...[16:08:30] work: average encoding speed for job is 0.000000 fps
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
[16:08:30] mpeg2 done: 146114 frames
[16:08:30] render: lost time: 2615613 (871 frames)
[16:08:30] render: gained time: 2613363 (3456 frames) (2250 not accounted for)
[16:08:30] render: average dropped frame duration: 3003
My disk isn't full. I switched my NFS options to set it to version 3 explicitly, (2 had a 2Gb limitation) and am now running the encode again. NFS should default to the highest version available and I haven't run into that error anywhere else, but I figure I'll eliminate the possibility. The fact that HandBrake reported that the "Value [is] too large for [the] defined data type" does concern me a bit, though.
Top
TedJ
Veteran User
Posts: 5388
Joined: Wed Feb 20, 2008 11:25 pm

Re: Odd error

Post by TedJ »

High bitrate or long feature? Perhaps you're exceeding 4GB on the encode, in which case you'll need to check the "large file size" button.

Can't be sure without a full activity log, mind you.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: Odd error

Post by maestro371 »

Just over 2Gb (2,147,539,329 bytes)

Here's the rest of the log (there weren't any other errors or abnormalities that I noticed):

Code: Select all

[10:32:39] hb_init: checking cpu count
[10:32:39] hb_init: starting libhb thread
HandBrake svn1866 (2008102501) - http://handbrake.fr/
4 CPUs detected
Opening ./THE_GODFATHER/...
[10:32:39] hb_scan: path=./THE_GODFATHER/, title_index=1
[10:32:39] scan: trying to open with libdvdread
[10:32:39] scan: DVD has 2 title(s)
[10:32:39] scan: scanning title 1
[10:32:39] scan: opening IFO for VTS 1
[10:32:39] pgc_id: 1, pgn: 1: pgc: 0x8dc4bf0
[10:32:39] scan: vts=1, ttn=1, cells=0->43, blocks=0->4018810, 4018811 blocks
[10:32:39] scan: duration is 02:55:18 (10518020 ms)
[10:32:39] scan: checking audio 1
[10:32:39] scan: id=80bd, lang=English (AC3), 3cc=eng ext=0
[10:32:39] scan: checking audio 2
[10:32:39] scan: id=81bd, lang=Francais (AC3), 3cc=fra ext=0
[10:32:39] scan: checking audio 3
[10:32:39] scan: id=82bd, lang=English (AC3) (Director's Commentary 1), 3cc=eng ext=3
[10:32:39] scan: checking subtitle 1
[10:32:39] scan: id=21bd, lang=English, 3cc=eng
[10:32:39] scan: checking subtitle 2
[10:32:39] scan: id=23bd, lang=Francais (Forced Caption), 3cc=fra
[10:32:39] scan: title 1 has 23 chapters
[10:32:39] scan: chap 1 c=0->0, b=0->131665 (131666), 421816 ms
[10:32:39] scan: chap 2 c=1->5, b=131666->391894 (260229), 631954 ms
[10:32:39] scan: chap 3 c=6->8, b=391895->608668 (216774), 538842 ms
[10:32:39] scan: chap 4 c=9->9, b=608669->764247 (155579), 436523 ms
[10:32:39] scan: chap 5 c=10->10, b=764248->882298 (118051), 358430 ms
[10:32:39] scan: chap 6 c=11->14, b=882299->1059261 (176963), 512988 ms
[10:32:39] scan: chap 7 c=15->15, b=1059262->1259362 (200101), 570827 ms
[10:32:39] scan: chap 8 c=16->16, b=1259363->1470226 (210864), 620764 ms
[10:32:39] scan: chap 9 c=17->17, b=1470227->1611045 (140819), 424509 ms
[10:32:39] scan: chap 10 c=18->18, b=1611046->1891158 (280113), 851197 ms
[10:32:39] scan: chap 11 c=19->19, b=1891159->2038177 (147019), 426511 ms
[10:32:39] scan: chap 12 c=20->28, b=2038178->2280987 (242810), 549580 ms
[10:32:39] scan: chap 13 c=29->30, b=2280988->2369649 (88662), 189633 ms
[10:32:39] scan: chap 14 c=31->31, b=2369650->2483994 (114345), 267453 ms
[10:32:39] scan: chap 15 c=32->32, b=2483995->2704509 (220515), 563842 ms
[10:32:39] scan: chap 16 c=33->35, b=2704510->2805658 (101149), 195742 ms
[10:32:39] scan: chap 17 c=36->36, b=2805659->2960349 (154691), 414517 ms
[10:32:39] scan: chap 18 c=37->37, b=2960350->3120291 (159942), 374635 ms
[10:32:39] scan: chap 19 c=38->38, b=3120292->3274821 (154530), 368628 ms
[10:32:39] scan: chap 20 c=39->39, b=3274822->3537386 (262565), 659000 ms
[10:32:39] scan: chap 21 c=40->40, b=3537387->3734494 (197108), 467727 ms
[10:32:39] scan: chap 22 c=41->41, b=3734495->3958018 (223524), 501621 ms
[10:32:39] scan: chap 23 c=42->43, b=3958019->4018810 (60792), 171268 ms
[10:32:39] scan: aspect = 0
[10:32:39] scan: decoding previews for title 1
[10:32:39] scan: audio 0x81bd: AC-3, rate=48000Hz, bitrate=192000 Francais (AC3) (2.0 ch)
[10:32:39] scan: audio 0x82bd: AC-3, rate=48000Hz, bitrate=192000 English (AC3) (Director's Commentary 1) (2.0 ch)
[10:32:39] scan: audio 0x80bd: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
Scanning title 1...
Scanning title 1...
Scanning title 1...
[10:32:40] scan: content PAR gives wrong aspect 1.78; using container aspect 1.78
[10:32:40] scan: 10 previews, 720x480, 23.976 fps, autocrop = 0/0/0/2, aspect 1.78:1, PAR 853:720
[10:32:40] scan: title (0) job->width:720, job->height:400
[10:32:40] libhb: scan thread found 1 valid title(s)
+ title 1:
  + vts 1, ttn 1, cells 0->43 (4018811 blocks)
  + duration: 02:55:18
  + size: 720x480, aspect: 1.78, 23.976 fps
  + autocrop: 0/0/0/2
  + chapters:
    + 1: cells 0->0, 131666 blocks, duration 00:07:02
    + 2: cells 1->5, 260229 blocks, duration 00:10:32
    + 3: cells 6->8, 216774 blocks, duration 00:08:59
    + 4: cells 9->9, 155579 blocks, duration 00:07:17
    + 5: cells 10->10, 118051 blocks, duration 00:05:58
    + 6: cells 11->14, 176963 blocks, duration 00:08:33
    + 7: cells 15->15, 200101 blocks, duration 00:09:31
    + 8: cells 16->16, 210864 blocks, duration 00:10:21
    + 9: cells 17->17, 140819 blocks, duration 00:07:05
    + 10: cells 18->18, 280113 blocks, duration 00:14:11
    + 11: cells 19->19, 147019 blocks, duration 00:07:07
    + 12: cells 20->28, 242810 blocks, duration 00:09:10
    + 13: cells 29->30, 88662 blocks, duration 00:03:10
    + 14: cells 31->31, 114345 blocks, duration 00:04:27
    + 15: cells 32->32, 220515 blocks, duration 00:09:24
    + 16: cells 33->35, 101149 blocks, duration 00:03:16
    + 17: cells 36->36, 154691 blocks, duration 00:06:55
    + 18: cells 37->37, 159942 blocks, duration 00:06:15
    + 19: cells 38->38, 154530 blocks, duration 00:06:09
    + 20: cells 39->39, 262565 blocks, duration 00:10:59
    + 21: cells 40->40, 197108 blocks, duration 00:07:48
    + 22: cells 41->41, 223524 blocks, duration 00:08:22
    + 23: cells 42->43, 60792 blocks, duration 00:02:51
  + audio tracks:
    + 1, English (AC3) (5.1 ch), 48000Hz, 448000bps
    + 2, Francais (AC3) (2.0 ch), 48000Hz, 192000bps
    + 3, English (AC3) (Director's Commentary 1) (2.0 ch), 48000Hz, 192000bps
  + subtitle tracks:
    + 1, English (iso639-2: eng)
    + 2, Francais (Forced Caption) (iso639-2: fra)
More audio codecs than audio tracks, copying track 1 and using encoder ac3
[10:32:40] 1 job(s) to process
[10:32:40] starting job
[10:32:40] job configuration:
[10:32:40]  * source
[10:32:40]    + ./THE_GODFATHER/
[10:32:40]    + title 1, chapter(s) 1 to 23
[10:32:40]  * destination
[10:32:40]    + /data/Entertainment/Movies/Drama/The Godfather.m4v
[10:32:40]    + container: MPEG-4 (.mp4 and .m4v)
[10:32:40]      + 64-bit formatting
[10:32:40]      + chapter markers
[10:32:40]  * video track
[10:32:40]    + decoder: mpeg2
[10:32:40]      + bitrate 9800 kbps
[10:32:40]    + frame rate: 23.976 fps -> variable fps
[10:32:40]    + strict anamorphic
[10:32:40]      + storage dimensions: 720 * 480 -> 718 * 480, crop 0/0/0/2
[10:32:40]      + pixel aspect ratio: 853 / 720
[10:32:40]      + display dimensions: 850 * 480
[10:32:40]    + color space: ITU Bt.601 (SD)
[10:32:40]    + filters
[10:32:40]      + Detelecine (pullup) (default settings)
[10:32:40]      + Deinterlaces selectively with yadif/mcdeint and lowpass5 blending (default settings)
[10:32:40]    + encoder: x264
[10:32:40]      + options: ref=3:mixed-refs=1:bframes=3:weightb=1:direct=auto:no-fast-pskip=1:me=umh:subq=7:analyse=all:b-adapt=2
[10:32:40]      + quality: 0.62
[10:32:40]  * audio track 0
[10:32:40]    + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[10:32:40]      + bitrate: 448 kbps, samplerate: 48000 Hz
[10:32:40]    + mixdown: Dolby Pro Logic II
[10:32:40]    + encoder: faac
[10:32:40]      + bitrate: 160 kbps, samplerate: 48000 Hz
[10:32:40]  * audio track 1
[10:32:40]    + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[10:32:40]      + bitrate: 448 kbps, samplerate: 48000 Hz
[10:32:40]    + AC3 passthrough
[10:32:40] yadif thread started for segment 0
[10:32:40] yadif thread started for segment 1
[10:32:40] yadif thread started for segment 2
[10:32:40] yadif thread started for segment 3
[10:32:40] decomb thread started for segment 0
[10:32:40] decomb thread started for segment 1
[10:32:40] decomb thread started for segment 2
[10:32:40] encx264: keyint-min: 24, keyint-max: 240
[10:32:40] decomb thread started for segment 3
[10:32:40] encx264: encoding with stored aspect 853/720
[10:32:40] encx264: Encoding at constant RF 19.380000
x264 [warning]: width or height not divisible by 16 (718x480), compression will suffer.
[10:32:40] reader: first SCR 146
x264 [info]: using SAR=853/720
x264 [info]: using cpu capabilities: MMX2 SSE2 SSE3 Cache64
No accelerated IMDCT transform found
[10:32:41] mpeg2: "Chapter 1" (1) at frame 0 time 3003
No accelerated IMDCT transform found
[10:32:41] sync: expecting 252204 video frames
[10:32:41] sync: first pts is 3003
Encoding: task 1 of 1, 4.00 % (11.72 fps, avg 8.71 fps, ETA 07h43m33s)[10:52:00] mpeg2: "Chapter 2" (2) at frame 10119 time 37987950
Encoding: task 1 of 1, 10.01 % (15.22 fps, avg 7.03 fps, ETA 08h58m06s)[11:32:33] mpeg2: "Chapter 3" (3) at frame 25291 time 94939845
Encoding: task 1 of 1, 15.15 % (2.66 fps, avg 7.07 fps, ETA 08h24m27s)[12:02:44] mpeg2: "Chapter 4" (4) at frame 38232 time 143513370
Encoding: task 1 of 1, 19.29 % (9.17 fps, avg 7.29 fps, ETA 07h45m23s)[12:23:56] mpeg2: "Chapter 5" (5) at frame 48696 time 182792610
Encoding: task 1 of 1, 22.70 % (11.28 fps, avg 7.45 fps, ETA 07h15m59s)[12:40:43] mpeg2: "Chapter 6" (6) at frame 57288 time 215044830
Encoding: task 1 of 1, 23.97 % (8.72 fps, avg 7.50 fps, ETA 07h05m49s)[12:46:56] 2522.887033s: Film -> Video
Encoding: task 1 of 1, 24.43 % (2.73 fps, avg 7.41 fps, ETA 07h08m39s)[12:51:18] 2561.892667s: Video -> Film
Encoding: task 1 of 1, 27.68 % (8.04 fps, avg 7.32 fps, ETA 06h55m03s)[13:11:33] mpeg2: "Chapter 7" (7) at frame 69850 time 261321060
Encoding: task 1 of 1, 33.11 % (9.84 fps, avg 7.33 fps, ETA 06h23m24s)[13:42:29] mpeg2: "Chapter 8" (8) at frame 83541 time 312714402
Encoding: task 1 of 1, 39.02 % (5.33 fps, avg 7.30 fps, ETA 05h51m18s)[14:17:28] mpeg2: "Chapter 9" (9) at frame 98437 time 368630262
Encoding: task 1 of 1, 43.05 % (14.43 fps, avg 7.31 fps, ETA 05h27m37s)[14:40:21] mpeg2: "Chapter 10" (10) at frame 108613 time 406828422
Encoding: task 1 of 1, 51.15 % (13.01 fps, avg 7.22 fps, ETA 04h44m35s)[15:30:37] mpeg2: "Chapter 11" (11) at frame 129025 time 483449967
Encoding: task 1 of 1, 55.20 % (13.93 fps, avg 7.27 fps, ETA 04h19m10s)[15:51:58] mpeg2: "Chapter 12" (12) at frame 139249 time 521823802
Encoding: task 1 of 1, 55.51 % (5.23 fps, avg 7.26 fps, ETA 04h17m34s)[15:54:00] 5830.317133s: Film -> Video
Encoding: task 1 of 1, 56.10 % (15.86 fps, avg 7.26 fps, ETA 04h14m13s)[15:57:34] 5880.667433s: Video -> Film
Encoding: task 1 of 1, 56.43 % (7.28 fps, avg 7.26 fps, ETA 04h12m07s)[15:59:10] 5914.567967s: Film -> Video
Encoding: task 1 of 1, 56.53 % (24.15 fps, avg 7.27 fps, ETA 04h11m22s)[15:59:36] 5923.710433s: Video -> Film
Encoding: task 1 of 1, 56.99 % (7.84 fps, avg 7.28 fps, ETA 04h08m23s)[16:01:50] 5971.691700s: Film -> Video
Encoding: task 1 of 1, 57.27 % (3.70 fps, avg 7.25 fps, ETA 04h07m43s)[16:04:45] 5995.448767s: Video -> Film
Encoding: task 1 of 1, 57.49 % (12.33 fps, avg 7.25 fps, ETA 04h06m24s)[16:05:57] 6018.505133s: Film -> Video
Encoding: task 1 of 1, 57.92 % (5.03 fps, avg 7.25 fps, ETA 04h03m57s)Value too large for defined data type
ERROR: Failed to write to output file, disk full?
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
ERROR: Failed to write to output file, disk full?
[16:08:30] sync: got 146081 frames, 252204 expected
[16:08:30] reader: done. 1 scr changes
Muxing: this may take awhile...[16:08:30] work: average encoding speed for job is 0.000000 fps
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
[16:08:30] mpeg2 done: 146114 frames
[16:08:30] render: lost time: 2615613 (871 frames)
[16:08:30] render: gained time: 2613363 (3456 frames) (2250 not accounted for)
[16:08:30] render: average dropped frame duration: 3003
x264 [info]: slice I:1172  Avg QP:16.63  size: 53618  PSNR Mean Y:45.55 U:50.25 V:50.65 Avg:46.58 Global:45.53
x264 [info]: slice P:50790 Avg QP:18.71  size: 20197  PSNR Mean Y:42.90 U:47.40 V:47.78 Avg:43.91 Global:42.77
x264 [info]: slice B:93181 Avg QP:20.61  size:  6430  PSNR Mean Y:42.16 U:47.44 V:47.82 Avg:43.31 Global:42.23
x264 [info]: consecutive B-frames:  1.8%  4.7% 92.8%  0.7%
x264 [info]: mb I  I16..4: 23.5%  0.0% 76.5%
x264 [info]: mb P  I16..4:  2.1%  0.0%  6.4%  P16..4: 43.1% 26.9% 18.9%  0.5%  0.2%    skip: 1.9%
x264 [info]: mb B  I16..4:  0.1%  0.0%  0.5%  B16..8: 55.2%  2.2%  3.8%  direct: 9.4%  skip:28.8%  L0:37.8% L1:44.2% BI:18.0%
x264 [info]: direct mvs  spatial:100.0%  temporal:0.0%
x264 [info]: ref P L0  75.4% 13.6% 11.0%
x264 [info]: ref B L0  88.0% 12.0%
x264 [info]: SSIM Mean Y:0.9727931
x264 [info]: PSNR Mean Y:42.445 U:47.453 V:47.833 Avg:43.544 Global:42.429 kb/s:2230.41
[16:08:31] decomb: yadif deinterlaced 7 | blend deinterlaced 8 | unfiltered 145162 | total 145177
[16:08:32] libhb: work result = 0

Rip done!
HandBrake has exited.
My re-started encode is still running. We'll see if it errors out again in a few hours.
Top
Cavalicious
Moderator
Posts: 1804
Joined: Mon Mar 26, 2007 12:07 am

Re: Odd error

Post by Cavalicious »

Try again on a Released version of HB (Public), as there is no support for svn.
Top
jbrjake
Veteran User
Posts: 4805
Joined: Wed Dec 13, 2006 1:38 am

Re: Odd error

Post by jbrjake »

Will make an exception for this one, since it might indicate a problem with the resurrected libmp4v2. Moving to bugs, unlocking.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Great - thanks.

I re-ran the encodes after double-checking my NFS settings and the encodes are being cut-off consistently right around 2 Gb:

2147539329 Oct 28 23:27 The Godfather.m4v
2147584822 Oct 29 04:54 The Godfather Part II-1.m4v

Unfortunately my WM crashed encoding the third video, so I don't have the error log. I'd expect that it would be the same as what I copied in previously.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Could the problem be in mp4descriptor.cpp, in this line?

Code: Select all

int32_t remaining = m_size - (pFile->GetPosition() - m_start);
In all other instances, GetPosition is associated with a uint64_t.
Top
eddyg
Veteran User
Posts: 798
Joined: Mon Apr 23, 2007 3:34 am

Re: [SVN 1866] MP4 error at > 2GB

Post by eddyg »

I'm not seeing this with the latest svn on macos.

I'm not saying that it isn't happening for you - just that I'm not reproducing it.

I'll try with your exact settings - must be unique to using MPEG-4 video - I was using h.264.

Cheers, Ed.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Thanks Ed. I'm running HB on Debian Etch. I updated to the latest SVN (1879) and did the encode again with the same results.

I just schlepped a 5Gb file from my network volume to a local disk to be certain that I wasn't having some obscure OS-related issue. The OS itself doesn't seem to have any trouble addressing large files.

I'll run it again with all the data on local drives (just to be absolutely certain there's no network-related issue) and I'll post the resulting log file in the morning.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Same results with 1879 confirmed:

Code: Select all

[22:22:14] hb_init: checking cpu count
[22:22:14] hb_init: starting libhb thread
HandBrake svn1879 (2008102901) - http://handbrake.fr/
4 CPUs detected
Opening /opt/tmp/THE_GODFATHER/...
[22:22:14] hb_scan: path=/opt/tmp/THE_GODFATHER/, title_index=1
[22:22:14] scan: trying to open with libdvdread
[22:22:14] scan: DVD has 2 title(s)
[22:22:14] scan: scanning title 1
[22:22:14] scan: opening IFO for VTS 1
[22:22:14] pgc_id: 1, pgn: 1: pgc: 0x8dc6bf0
[22:22:14] scan: vts=1, ttn=1, cells=0->43, blocks=0->4018810, 4018811 blocks
[22:22:14] scan: duration is 02:55:18 (10518020 ms)
[22:22:14] scan: checking audio 1
[22:22:14] scan: id=80bd, lang=English (AC3), 3cc=eng ext=0
[22:22:14] scan: checking audio 2
[22:22:14] scan: id=81bd, lang=Francais (AC3), 3cc=fra ext=0
[22:22:14] scan: checking audio 3
[22:22:14] scan: id=82bd, lang=English (AC3) (Director's Commentary 1), 3cc=eng ext=3
[22:22:14] scan: checking subtitle 1
[22:22:14] scan: id=21bd, lang=English, 3cc=eng
[22:22:14] scan: checking subtitle 2
[22:22:14] scan: id=23bd, lang=Francais (Forced Caption), 3cc=fra
[22:22:14] scan: title 1 has 23 chapters
[22:22:14] scan: chap 1 c=0->0, b=0->131665 (131666), 421816 ms
[22:22:14] scan: chap 2 c=1->5, b=131666->391894 (260229), 631954 ms
[22:22:14] scan: chap 3 c=6->8, b=391895->608668 (216774), 538842 ms
[22:22:14] scan: chap 4 c=9->9, b=608669->764247 (155579), 436523 ms
[22:22:14] scan: chap 5 c=10->10, b=764248->882298 (118051), 358430 ms
[22:22:14] scan: chap 6 c=11->14, b=882299->1059261 (176963), 512988 ms
[22:22:14] scan: chap 7 c=15->15, b=1059262->1259362 (200101), 570827 ms
[22:22:14] scan: chap 8 c=16->16, b=1259363->1470226 (210864), 620764 ms
[22:22:14] scan: chap 9 c=17->17, b=1470227->1611045 (140819), 424509 ms
[22:22:14] scan: chap 10 c=18->18, b=1611046->1891158 (280113), 851197 ms
[22:22:14] scan: chap 11 c=19->19, b=1891159->2038177 (147019), 426511 ms
[22:22:14] scan: chap 12 c=20->28, b=2038178->2280987 (242810), 549580 ms
[22:22:14] scan: chap 13 c=29->30, b=2280988->2369649 (88662), 189633 ms
[22:22:14] scan: chap 14 c=31->31, b=2369650->2483994 (114345), 267453 ms
[22:22:14] scan: chap 15 c=32->32, b=2483995->2704509 (220515), 563842 ms
[22:22:14] scan: chap 16 c=33->35, b=2704510->2805658 (101149), 195742 ms
[22:22:14] scan: chap 17 c=36->36, b=2805659->2960349 (154691), 414517 ms
[22:22:14] scan: chap 18 c=37->37, b=2960350->3120291 (159942), 374635 ms
[22:22:14] scan: chap 19 c=38->38, b=3120292->3274821 (154530), 368628 ms
[22:22:14] scan: chap 20 c=39->39, b=3274822->3537386 (262565), 659000 ms
[22:22:14] scan: chap 21 c=40->40, b=3537387->3734494 (197108), 467727 ms
[22:22:14] scan: chap 22 c=41->41, b=3734495->3958018 (223524), 501621 ms
[22:22:14] scan: chap 23 c=42->43, b=3958019->4018810 (60792), 171268 ms
[22:22:14] scan: aspect = 0
[22:22:14] scan: decoding previews for title 1
[22:22:14] scan: audio 0x81bd: AC-3, rate=48000Hz, bitrate=192000 Francais (AC3) (2.0 ch)
[22:22:14] scan: audio 0x82bd: AC-3, rate=48000Hz, bitrate=192000 English (AC3) (Director's Commentary 1) (2.0 ch)
[22:22:14] scan: audio 0x80bd: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
Scanning title 1...
Scanning title 1...
[22:22:15] scan: content PAR gives wrong aspect 1.78; using container aspect 1.78
[22:22:15] scan: 10 previews, 720x480, 23.976 fps, autocrop = 0/0/0/2, aspect 1.78:1, PAR 853:720
[22:22:15] scan: title (0) job->width:720, job->height:400
[22:22:15] libhb: scan thread found 1 valid title(s)
+ title 1:
  + vts 1, ttn 1, cells 0->43 (4018811 blocks)
  + duration: 02:55:18
  + size: 720x480, aspect: 1.78, 23.976 fps
  + autocrop: 0/0/0/2
  + chapters:
    + 1: cells 0->0, 131666 blocks, duration 00:07:02
    + 2: cells 1->5, 260229 blocks, duration 00:10:32
    + 3: cells 6->8, 216774 blocks, duration 00:08:59
    + 4: cells 9->9, 155579 blocks, duration 00:07:17
    + 5: cells 10->10, 118051 blocks, duration 00:05:58
    + 6: cells 11->14, 176963 blocks, duration 00:08:33
    + 7: cells 15->15, 200101 blocks, duration 00:09:31
    + 8: cells 16->16, 210864 blocks, duration 00:10:21
    + 9: cells 17->17, 140819 blocks, duration 00:07:05
    + 10: cells 18->18, 280113 blocks, duration 00:14:11
    + 11: cells 19->19, 147019 blocks, duration 00:07:07
    + 12: cells 20->28, 242810 blocks, duration 00:09:10
    + 13: cells 29->30, 88662 blocks, duration 00:03:10
    + 14: cells 31->31, 114345 blocks, duration 00:04:27
    + 15: cells 32->32, 220515 blocks, duration 00:09:24
    + 16: cells 33->35, 101149 blocks, duration 00:03:16
    + 17: cells 36->36, 154691 blocks, duration 00:06:55
    + 18: cells 37->37, 159942 blocks, duration 00:06:15
    + 19: cells 38->38, 154530 blocks, duration 00:06:09
    + 20: cells 39->39, 262565 blocks, duration 00:10:59
    + 21: cells 40->40, 197108 blocks, duration 00:07:48
    + 22: cells 41->41, 223524 blocks, duration 00:08:22
    + 23: cells 42->43, 60792 blocks, duration 00:02:51
  + audio tracks:
    + 1, English (AC3) (5.1 ch), 48000Hz, 448000bps
    + 2, Francais (AC3) (2.0 ch), 48000Hz, 192000bps
    + 3, English (AC3) (Director's Commentary 1) (2.0 ch), 48000Hz, 192000bps
  + subtitle tracks:
    + 1, English (iso639-2: eng)
    + 2, Francais (Forced Caption) (iso639-2: fra)
More audio codecs than audio tracks, copying track 1 and using encoder ac3
[22:22:15] 1 job(s) to process
[22:22:15] starting job
[22:22:15] job configuration:
[22:22:15]  * source
[22:22:15]    + /opt/tmp/THE_GODFATHER/
[22:22:15]    + title 1, chapter(s) 1 to 23
[22:22:15]  * destination
[22:22:15]    + /opt/tmp/The Godfather.m4v
[22:22:15]    + container: MPEG-4 (.mp4 and .m4v)
[22:22:15]      + 64-bit formatting
[22:22:15]      + chapter markers
[22:22:15]  * video track
[22:22:15]    + decoder: mpeg2
[22:22:15]      + bitrate 9800 kbps
[22:22:15]    + frame rate: 23.976 fps -> variable fps
[22:22:15]    + strict anamorphic
[22:22:15]      + storage dimensions: 720 * 480 -> 718 * 480, crop 0/0/0/2
[22:22:15]      + pixel aspect ratio: 853 / 720
[22:22:15]      + display dimensions: 850 * 480
[22:22:15]    + color space: ITU Bt.601 (SD)
[22:22:15]    + filters
[22:22:15]      + Detelecine (pullup) (default settings)
[22:22:15]      + Deinterlaces selectively with yadif/mcdeint and lowpass5 blending (default settings)
[22:22:15]    + encoder: x264
[22:22:15]      + options: ref=3:mixed-refs=1:bframes=3:weightb=1:direct=auto:no-fast-pskip=1:me=umh:subq=7:analyse=all:b-adapt=2
[22:22:15]      + quality: 0.62
[22:22:15]  * audio track 0
[22:22:15]    + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[22:22:15]      + bitrate: 448 kbps, samplerate: 48000 Hz
[22:22:15]    + mixdown: Dolby Pro Logic II
[22:22:15]    + encoder: faac
[22:22:15]      + bitrate: 160 kbps, samplerate: 48000 Hz
[22:22:15]  * audio track 1
[22:22:15]    + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[22:22:15]      + bitrate: 448 kbps, samplerate: 48000 Hz
[22:22:15]    + AC3 passthrough
[22:22:15] yadif thread started for segment 0
[22:22:15] yadif thread started for segment 1
[22:22:15] yadif thread started for segment 2
[22:22:15] yadif thread started for segment 3
[22:22:15] decomb thread started for segment 0
[22:22:15] decomb thread started for segment 1
[22:22:15] decomb thread started for segment 2
[22:22:15] decomb thread started for segment 3
[22:22:15] reader: first SCR 146
[22:22:15] mpeg2: "Chapter 1" (1) at frame 0 time 3003
[22:22:15] encx264: keyint-min: 24, keyint-max: 240
[22:22:15] encx264: encoding with stored aspect 853/720
[22:22:15] encx264: Encoding at constant RF 19.380000
x264 [warning]: width or height not divisible by 16 (718x480), compression will suffer.
x264 [info]: using SAR=853/720
x264 [info]: using cpu capabilities: MMX2 SSE2 SSE3 Cache64
No accelerated IMDCT transform found
No accelerated IMDCT transform found
[22:22:15] sync: expecting 252204 video frames
[22:22:15] sync: first pts is 3003
Encoding: task 1 of 1, 4.00 % (11.91 fps, avg 9.67 fps, ETA 06h57m11s)[22:39:39] mpeg2: "Chapter 2" (2) at frame 10119 time 37987950
Encoding: task 1 of 1, 10.01 % (14.78 fps, avg 8.00 fps, ETA 07h52m55s)[23:14:53] mpeg2: "Chapter 3" (3) at frame 25291 time 94939845
Encoding: task 1 of 1, 15.15 % (4.14 fps, avg 8.02 fps, ETA 07h24m50s)[23:41:40] mpeg2: "Chapter 4" (4) at frame 38232 time 143513370
Encoding: task 1 of 1, 19.30 % (9.20 fps, avg 8.24 fps, ETA 06h51m51s)[00:00:43] mpeg2: "Chapter 5" (5) at frame 48696 time 182792610
Encoding: task 1 of 1, 22.70 % (12.49 fps, avg 8.36 fps, ETA 06h28m37s)[00:16:23] mpeg2: "Chapter 6" (6) at frame 57288 time 215044830
Encoding: task 1 of 1, 23.97 % (7.89 fps, avg 8.40 fps, ETA 06h20m26s)[00:22:11] 2522.887033s: Film -> Video
Encoding: task 1 of 1, 24.44 % (4.50 fps, avg 8.27 fps, ETA 06h24m09s)[00:26:29] 2561.892667s: Video -> Film
Encoding: task 1 of 1, 27.68 % (4.35 fps, avg 8.11 fps, ETA 06h14m48s)[00:45:44] mpeg2: "Chapter 7" (7) at frame 69850 time 261321060
Encoding: task 1 of 1, 33.11 % (9.13 fps, avg 8.11 fps, ETA 05h46m53s)[01:13:58] mpeg2: "Chapter 8" (8) at frame 83541 time 312714402
Encoding: task 1 of 1, 39.02 % (2.60 fps, avg 8.06 fps, ETA 05h17m51s)[01:45:39] mpeg2: "Chapter 9" (9) at frame 98437 time 368630262
Encoding: task 1 of 1, 43.06 % (13.82 fps, avg 8.05 fps, ETA 04h57m15s)[02:07:00] mpeg2: "Chapter 10" (10) at frame 108613 time 406828422
Encoding: task 1 of 1, 51.15 % (15.92 fps, avg 7.95 fps, ETA 04h18m12s)[02:52:33] mpeg2: "Chapter 11" (11) at frame 129025 time 483449967
Encoding: task 1 of 1, 55.20 % (14.35 fps, avg 8.01 fps, ETA 03h55m07s)[03:11:57] mpeg2: "Chapter 12" (12) at frame 139249 time 521823802
Encoding: task 1 of 1, 55.51 % (5.47 fps, avg 8.00 fps, ETA 03h53m39s)[03:13:44] 5830.317133s: Film -> Video
Encoding: task 1 of 1, 56.10 % (16.33 fps, avg 7.99 fps, ETA 03h50m54s)[03:17:23] 5880.667433s: Video -> Film
Encoding: task 1 of 1, 56.43 % (8.86 fps, avg 8.00 fps, ETA 03h49m00s)[03:18:47] 5914.567967s: Film -> Video
Encoding: task 1 of 1, 56.53 % (23.22 fps, avg 8.00 fps, ETA 03h48m22s)[03:19:17] 5923.710433s: Video -> Film
Encoding: task 1 of 1, 56.99 % (7.01 fps, avg 8.01 fps, ETA 03h45m42s)[03:21:19] 5971.691700s: Film -> Video
Encoding: task 1 of 1, 57.28 % (5.18 fps, avg 7.97 fps, ETA 03h45m14s)[03:24:11] 5995.448767s: Video -> Film
Encoding: task 1 of 1, 57.49 % (11.96 fps, avg 7.98 fps, ETA 03h43m53s)[03:25:03] 6018.505133s: Film -> Video
Encoding: task 1 of 1, 57.91 % (4.74 fps, avg 7.97 fps, ETA 03h41m59s)MP4ERROR: Encoding: task 1 of 1, 57.91 % (4.74 fps, avg 7.97 fps, ETA 03h41m59s)Value too large for defined data type
Encoding: task 1 of 1, 57.91 % (4.74 fps, avg 7.97 fps, ETA 03h41m59s)ERROR: Failed to write to output file, disk full?
Muxing: this may take awhile...[03:27:43] sync: got 146054 frames, 252204 expected
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
ERROR: Failed to write to output file, disk full?
[03:27:44] work: average encoding speed for job is 0.000000 fps
[03:27:44] reader: done. 1 scr changes
MP4ERROR: MP4-FILE_GetPosition: Value too large for defined data type
[03:27:44] mpeg2 done: 146087 frames
[03:27:44] render: lost time: 2597595 (865 frames)
[03:27:44] render: gained time: 2597595 (3435 frames) (0 not accounted for)
[03:27:44] render: average dropped frame duration: 3003
x264 [info]: slice I:1172  Avg QP:16.63  size: 53618  PSNR Mean Y:45.55 U:50.25 V:50.65 Avg:46.58 Global:45.53
x264 [info]: slice P:50787 Avg QP:18.71  size: 20197  PSNR Mean Y:42.90 U:47.40 V:47.78 Avg:43.91 Global:42.77
x264 [info]: slice B:93176 Avg QP:20.61  size:  6430  PSNR Mean Y:42.16 U:47.44 V:47.82 Avg:43.31 Global:42.23
x264 [info]: consecutive B-frames:  1.8%  4.7% 92.8%  0.7%
x264 [info]: mb I  I16..4: 23.5%  0.0% 76.5%
x264 [info]: mb P  I16..4:  2.1%  0.0%  6.4%  P16..4: 43.1% 26.9% 18.9%  0.5%  0.2%    skip: 1.9%
x264 [info]: mb B  I16..4:  0.1%  0.0%  0.5%  B16..8: 55.2%  2.2%  3.8%  direct: 9.4%  skip:28.8%  L0:37.8% L1:44.2% BI:18.0%
x264 [info]: direct mvs  spatial:100.0%  temporal:0.0%
x264 [info]: ref P L0  75.4% 13.6% 11.0%
x264 [info]: ref B L0  88.0% 12.0%
x264 [info]: SSIM Mean Y:0.9727936
x264 [info]: PSNR Mean Y:42.445 U:47.453 V:47.833 Avg:43.544 Global:42.429 kb/s:2230.43
[03:27:45] decomb: yadif deinterlaced 7 | blend deinterlaced 8 | unfiltered 145141 | total 145156
[03:27:45] libhb: work result = 0

Rip done!
HandBrake has exited.
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

For the time being, I've reverted to SVN 1832 - I think 1833 is where libmp4v2 was changed.

1832 doesn't seem to have any problems powering through the larger encodes. I completed the one that's been hanging up the newer revisions last night with no trouble.
Top
eddyg
Veteran User
Posts: 798
Joined: Mon Apr 23, 2007 3:34 am

Re: [SVN 1866] MP4 error at > 2GB

Post by eddyg »

Looking at the code the only way to get this error is here:

Code: Select all

int FILE_GetPosition(void *user, uint64_t *position)
{
    FILE *fp = (FILE *)user;

    off_t fpos = ftello(fp);
    if (fpos == -1) {
        throw new MP4Error(errno, "MP4-FILE_GetPosition");
    }
    *position = (uint64_t)fpos;
    return 0;
}
So the system call ftello has returned -1, and has set errno to EOVERFLOW.

Looking up the manual page for ftello on debian, and doing some googling, tells me that we must define __USE_LARGEFILE before including the stdio.h (for ftello). That will define off_t to be 64bit, else you won't be able to encode files over 2Gb.

So this is a build issue on Linux within libmp4v2.

Cheers, Ed.
Top
eddyg
Veteran User
Posts: 798
Joined: Mon Apr 23, 2007 3:34 am

Re: [SVN 1866] MP4 error at > 2GB

Post by eddyg »

Fixed by KonaBlend in mp4v2@44

Need to wait for that to be available within HB now though.

Cheers, Ed.
Top
KonaBlend
Novice
Posts: 72
Joined: Tue Nov 04, 2008 2:35 am

Re: [SVN 1866] MP4 error at > 2GB

Post by KonaBlend »

my bad. In retooling libmp4v2, I noticed that LFS compile flags were kicking in when *not* required, so I put a guard around the option to kick in only on 32-bit cpus, 'i386' and 'ppc' as identified by autotools host_cpu . Unfortunately, this value is i386 on some systems (Solaris), and more often than not, i686 on linux. So as of mp4v2 r44, we now wildcard it for 'i?86' which should work as expected.
Top
jbrjake
Veteran User
Posts: 4805
Joined: Wed Dec 13, 2006 1:38 am

Re: [SVN 1866] MP4 error at > 2GB

Post by jbrjake »

Thanks KonaBlend.

http://trac.handbrake.fr/changeset/1897
Top
maestro371
Novice
Posts: 53
Joined: Sat Aug 04, 2007 8:35 pm

Re: [RESOLVED] [SVN 1866] MP4 error at > 2GB

Post by maestro371 »

Looks great; just passed the 2GB point on my test encode. Thanks!
Top
Post Reply

Return to “Bugs”