TS HD problem

[barbatrukko]

Hi,
I have some TS HD record from my decoder. I don't know why, but in TS HD (and not in TS SD) sometime i found many errors.
I dowloaded and I'm trying TSDoctor and i HAVE some strage behavior.

1) this TS (corrupted i suppose) have some errors in stream audio/video
2) but if i play file with MediaPlayerClassic i can see all video (with error where are presente, but allways with sync audio/video)
3) ToolS -> Format converter.... "Can't detect any audio/video stream"
4) If i open with TSDoctor e then save fixed file (also without cut)  or also tools->tsremuxer , the result file lost audio video sync after some error. The fixed ts lost sync and more if i try to convert the result mp4 or mkv lost audio/video sync

In summary:
I have a TS file that seems to have errors in the stream. But the same file, regardless of the internal errors, is not recognized as such by all programs. So even the container has problems?
If i simply remux (no cut for now)
TS -> ts : lost sync
TS -> M2TS : no audio (maybe problem of my player)
TS -> MP4/MKV lost sync

Why lost sync if TS doctor found error and told me that fix it?
I want understand if this tool is really usefull for me.

Best regards

[Cypheros]

Use the TS-Remuxer instead of the TS Formatconverter. If the audio is AC3 or EAC3 the bad audio packets will be replaced and that should advoid synch problems. This kind of repair is only possible during the demuxing process the TS-Remuxer is doing before muxing the stream together again.

[barbatrukko]

I did.
Aldo with TS-Remuxer, the new TS are out of sync.
I see from log that TS-Remux try to replace bad audio... but after the TS_Fix.ts file are not in sync.

[Cypheros]

Do you have a log of this file?

[barbatrukko]

I can have.
Tell me what I MUST to do, fron the open file to te log creation and I will do.

[Cypheros]

For any remuxed file a log is created. It's a text file with the extension ".log"

[barbatrukko]

This is the last I did. Is not teh same source of the previous but have the same mouch warning and error (specialli audio)


Opening file K:\Records\db041f0f\db041f0f.ts

OS: Windows 7 Service Pack 1
TSDoctor.exe V 1.2.22 (Build 029E52)
NVIDIA Quadro FX 880M (DISPLAY2)
NVIDIA Quadro FX 880M (DISPLAY1)
Supported TS source filter found  : TS Doctor FileSource (on)
Supported splitter filter found   : Haali Media Splitter
Supported audio filter found      : ffdshow Audio Decoder, Microsoft DTV-DVD Audio Decoder
Supported Mpeg video filter found : ffdshow Video Decoder(3771), CyberLink Video/SP Decoder, Microsoft DTV-DVD Video Decoder
Supported H264 video filter found : DivX H.264 Decoder, ffdshow Video Decoder(3771), Microsoft DTV-DVD Video Decoder
Supported video renderer found    : Video Renderer, Enhanced Video Renderer

File size: 1503903744
Packets  : 7999488


Scanning for TRP fill packets

Scanning for PIDs

Found 2 different PIDs

Identifying stream types

$00A2: 95%  = H264 Video (PES_StreamID E0 = Video_Stream_0) [PCR,PTS,DTS]
$0194: 5%   = AC3 Audio (PES_StreamID BD = Private_Stream_1) [PTS][PESLength]


Scanning for PATs

No valid PAT found!
--- PAT/PMT creation mode ---
Creating new PAT for PMT PID 00B1

----------- PAT 0 -----------
PacketCount              : 0
Table ID                 : 0
Section Syntax Indicator : 1
Reserved Bit 0           : 0
Reserved Bit 1           : 1
Reserved Bit 2           : 1
Pointer Field            : 0
Section Length           : 13
Transport Stream ID      : 6
Reserved Bit 3           : 1
Reserved Bit 4           : 1
Version Number           : 11
Current Next Indicator   : 1
Section Number           : 0
Last Section Number      : 0

  Program Number : $0001
  Map PID        : $00B1

CRC32                    : $44FB9EB4 = $44FB9EB4
-----------------------------


Found 1 different PATs
Found 1 different PMT PIDs
Creating new PMT PID 00B1
PCR for selfmade PMT: 00A2
New PMT: CRC OK!


0.
  stream_type              : 27 = AVC video stream as defined in ITU-T Rec. H.264 | ISO/IEC 14496-10 Video
  elementary_pid           : 00A2
  ES_info_length           : 12

1.
  stream_type              : 129 = Private stream type Audio AC3 (AC3)
  elementary_pid           : 0194
  ES_info_length           : 12

PCR PID is 00A2

Created PAT:

----------- PAT 0 -----------
PacketCount              : 0
Table ID                 : 0
Section Syntax Indicator : 1
Reserved Bit 0           : 0
Reserved Bit 1           : 1
Reserved Bit 2           : 1
Pointer Field            : 0
Section Length           : 13
Transport Stream ID      : 6
Reserved Bit 3           : 1
Reserved Bit 4           : 1
Version Number           : 11
Current Next Indicator   : 1
Section Number           : 0
Last Section Number      : 0

  Program Number : $0001
  Map PID        : $00B1

CRC32                    : $44FB9EB4 = $44FB9EB4
-----------------------------



Created PMT:

----------- PMT 0 -----------
Packet                   :
PacketCount              : 0
PID                      : $00B1
Table ID                 : 2
Section Syntax Indicator : 1
PMT Size                 : 55
Pointer Field            : 0
Section Length           : 47
Program Number           : $0001
Version Number           : 0
Current Next Indicator   : 1
Section Number           : 0
Last Section Number      : 0
PCR PID                  : $00A2

Program Info Length      : 0

  Stream Type    : 27
  Description    : AVC video stream as defined in ITU-T Rec. H.264 | ISO/IEC 14496-10 Video
  Elementary PID : $00A2
  ES Info Length : 12
  ES Info        : $28, $04, $64, $00, $29, $BF, $0A, $04, $65, $6E, $67, $00
  ES Info Text   : (_d_)¿__eng_

  Stream Type    : 129
  Description    : Private stream type Audio AC3 (AC3)
  Elementary PID : $0194
  ES Info Length : 12
  ES Info        : $05, $04, $41, $43, $2D, $33, $0A, $04, $67, $65, $72, $00
  ES Info Text   : __AC-3__ger_

CRC32                    : $77A91420 = $77A91420
-----------------------------


First video PTS is 1763501734 05:26:34.464
Last video PTS  is -1 -00:00:00.000

First PCR  is 529032818400 05:26:33.808
Last PCR  is 580659451005 05:58:25.906
Duration of video stream is 172088775 00:31:52.097
Video PCR to PTS difference -778 ms
$0194: Delay to video stream = -575ms


The following PIDs will be imported into new stream: $00A2, 0194

Scanning for video details

-------- H264 Video ---------
profile_idc                            : 77
constrained_set0_flag                  : 0
constrained_set1_flag                  : 1
constrained_set2_flag                  : 0
constrained_set3_flag                  : 0
reserved_zero_4bits                    : 0
level_idc                              : 40
seq_parameter_set_id                   : 0
log2_max_frame_num_minus4              : 2
pic_order_cnt_type                     : 0
log2_max_pic_order_cnt_lsb_minus4      : 4
num_ref_frames                         : 4
gaps_in_frame_num_value_allowed_flag   : 0
pic_width_in_mbs_minus1                : 119
pic_height_in_map_units_minus1         : 33
frame_mbs_only_flag                    : 0
mb_adaptive_frame_field_flag           : 1
direct_8x8_inference_flag              : 1
frame_cropping_flag                    : 1
frame_crop_left_offset                 : 0
frame_crop_right_offset                : 0
frame_crop_top_offset                  : 0
frame_crop_bottom_offset               : 2
vui_parameters_present_flag            : 1
aspect_ratio_info_present_flag         : 1
aspect_ratio_idv                       : 1
overscan_info_present_flag             : 1
overscan_appropriate_flag              : 1
video_signal_type_present_flag         : 1
video_format                           : 5
video_full_range_flag                  : 0
colour_description_present_flag        : 1
colour_primaries                       : 1
transfer_characteristics               : 1
matrix_coefficients                    : 1
chroma_loc_info_present_flag           : 1
chroma_sample_loc_type_top_field       : 0
chroma_sample_loc_type_bottom_field    : 0
timing_info_present_flag               : 1
num_units_in_tick                      : 1
time_scale                             : 50
fixed_frame_rate_flag                  : 1
nal_hrd_parameters_present_flag        : 0
vcl_hrd_parameters_present_flag        : 0
-----------------------------

Video format: H264 1920x1088i/AR=16:9/25 fps/Main@4.0
Colorimetry : ColourPrimaries=BT.709, TransferCharacteristics=BT.709, MatrixCoefficients=BT.709
First I-Frame PTS at 05:26:35.464 [00:00:01.000]
First GOP = 24 frames : I0 B248 B244 B242 B246 B252 B250 B254 P16 B8 B4 B2 B6 B12 B10 B14 P32 B24 B20 B18 B22 B28 B26 B30

Scanning for audio details
AC3 2 channels: 3 times
AC3 6 channels: 15 times
AC3 detection mode: Prefer 5.1
$0194 2 different AC3 types detected!
$0194 selecting AC3 type with mode 5.1
Audio stream 1: AC3 5.1 48000Hz (GER)
Nearest I-Frame not found (out)!
I/P frame alignment problems

Cutting areas (I/P-Frame aligned)
Cut 1 In : 05:29:05.544 (AUD|SPS|PPS|SEI|IDR|IDR|IDR|IDR|IDR|IDR|FILL|)
Cut 1 Out: 05:58:26.561 ()
Cut 1 PCR/PTS/DTS offset: 00:00:00.000



Cut in  at PCR: 00:02:31.080 (05:29:04.888)
Cut out at PCR: 00:31:52.097 (05:58:25.906)
First packet  : 000D853C
Last packet   : 007A1000

Starting at paket 000D853C PCR: 00:02:31.030 (05:29:04.838)
ES  WARNING: For PID 0194 AC3 properties changed at 00:02:31.337 (2.0 48kHz >>> 5.1 48kHz)
TS  WARNING: For PID 00A2 00:01:33.346 TS packet 00149FFF: Packet discontinuity  last=15 , current=5
TS  WARNING: For PID 0194 00:01:33.346 TS packet 0014A01F: Packet discontinuity  last=6 , current=2
PES ERROR  : For PID 0194 00:01:33.443 PES paket 00001DD2 is invalid (SizeMismatch), starting with TS paket 00149F80 Size: 1198 should be 1544
TS  WARNING: For PID 00A2 00:01:33.697 TS packet 0014AFFF: Packet discontinuity  last=8 , current=7
TS  WARNING: For PID 0194 00:01:33.697 TS packet 0014B006: Packet discontinuity  last=13 , current=2
PES ERROR  : For PID 0194 00:01:33.795 PES paket 00001DDC is invalid (SizeMismatch), starting with TS paket 0014AEE7 Size: 1203 should be 1544
TS  WARNING: For PID 00A2 00:20:32.993 TS packet 005B6FFF: Packet discontinuity  last=6 , current=11
TS  WARNING: For PID 0194 00:20:32.993 TS packet 005B7018: Packet discontinuity  last=1 , current=10
PES ERROR  : For PID 0194 00:20:33.059 PES paket 0000A8EC is invalid (SizeMismatch), starting with TS paket 005B6E8E Size: 2404 should be 1544
TS  WARNING: For PID 00A2 00:20:33.484 TS packet 005B7FFF: Packet discontinuity  last=5 , current=10
TS  WARNING: For PID 0194 00:20:33.484 TS packet 005B8001: Packet discontinuity  last=14 , current=10
PES ERROR  : For PID 0194 00:20:33.571 PES paket 0000A8F7 is invalid (SizeMismatch), starting with TS paket 005B7F43 Size: 1198 should be 1544
TS  WARNING: For PID 00A2 00:20:34.044 TS packet 005B8FFF: Packet discontinuity  last=2 , current=12
TS  WARNING: For PID 0194 00:20:34.044 TS packet 005B9005: Packet discontinuity  last=0 , current=3
ES  ERROR  : For PID 0194 00:23:04.521 AC3 paket 0000A901 has AC3 Crc error
ES  ERROR  : For PID 0194 00:31:26.089 AC3 paket 0000E639 has AC3 Crc error
PES ERROR  : For PID 0194 00:17:58.271 PES paket 0000E65C is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsPTS2,MarkerBit3PTS2,ControlBitsDTS,MarkerBit1DTS,SizeMismatch), starting with TS paket 007891CF Size: 189 should be 20696
PES ERROR  : For PID 00A2 00:13:16.664 PES paket 0000C3DD is invalid (PSCPrefix,StreamType,Scrambled,MarkerBit2PTS,SizeMismatch), starting with TS paket 0078A109 Size: 16 should be 9533
PES ERROR  : For PID 0194 00:09:53.103 PES paket 0000E6E7 is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsPTS2,MarkerBit1PTS2,MarkerBit2PTS2,MarkerBit3PTS2,ControlBitsDTS,MarkerBit1DTS,MarkerBit2DTS,MarkerBit3DTS,SizeMismatch), starting with TS paket 0078DC35 Size: 74 should be 54442
PES ERROR  : For PID 00A2 00:02:27.348 PES paket 0000C443 is invalid (PSCPrefix,StreamType,Scrambled,MarkerBit1PTS,MarkerBit2PTS,MarkerBit3PTS,SizeMismatch), starting with TS paket 0078E278 Size: 241 should be 27163
PES ERROR  : For PID 00A2 00:09:34.458 PES paket 0000C44C is invalid (PSCPrefix,StreamType,Scrambled,MarkerBit2PTS,SizeMismatch), starting with TS paket 0078EAB7 Size: 80 should be 54503
PES ERROR  : For PID 00A2 00:23:31.302 PES paket 0000C4B1 is invalid (PSCPrefix,Scrambled,MarkerBit1PTS,MarkerBit2PTS,MarkerBit3PTS,SizeMismatch), starting with TS paket 00792C90 Size: 7675 should be 24121
PES ERROR  : For PID 0194 00:08:52.706 PES paket 0000E7EE is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsPTS,MarkerBit2PTS,SizeMismatch), starting with TS paket 00795F80 Size: 166 should be 3168
PES ERROR  : For PID 0194 00:10:05.347 PES paket 0000E7F3 is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsHd,ControlBitsPTS2,MarkerBit1PTS2,ControlBitsDTS,MarkerBit1DTS,MarkerBit3DTS,SizeMismatch), starting with TS paket 007961F1 Size: 175 should be 56318
PES ERROR  : For PID 00A2 00:02:02.636 PES paket 0000C522 is invalid (PSCPrefix,Scrambled,MarkerBit1PTS2,MarkerBit2PTS2,MarkerBit3PTS2,MarkerBit1DTS,SizeMismatch), starting with TS paket 00796BA7 Size: 14483 should be 5671
PES ERROR  : For PID 0194 00:15:19.750 PES paket 0000E898 is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsHd,ControlBitsPTS2,MarkerBit2PTS2,ControlBitsDTS,MarkerBit2DTS,SizeMismatch), starting with TS paket 0079AFB8 Size: 143 should be 63122
PES ERROR  : For PID 0194 00:18:08.683 PES paket 0000E8A0 is invalid (PSCPrefix,StreamType,Scrambled,ControlBitsHd,ControlBitsPTS,MarkerBit2PTS,SizeMismatch), starting with TS paket 0079B315 Size: 108 should be 46499
PES ERROR  : For PID 0194 00:12:07.893 PES paket 0000E8D7 is invalid (PSCPrefix,ControlBitsHd,ControlBitsPTS,MarkerBit2PTS,MarkerBit3PTS,SizeMismatch), starting with TS paket 0079D45C Size: 1544 should be 34284
PES ERROR  : For PID 00A2 00:23:55.250 PES paket 0000C5CF is invalid (PSCPrefix,StreamType,MarkerBit2PTS2,MarkerBit2DTS,SizeMismatch), starting with TS paket 0079D835 Size: 122 should be 50292
PES WARNING: For PID 00A2 DVB/ATSC unconform PES formating detected: PSCPrefix,StreamType,Scrambled,ControlBitsHd,ControlBitsPTS,MarkerBit1PTS,MarkerBit2PTS,MarkerBit3PTS,ControlBitsPTS2,MarkerBit1PTS2,MarkerBit2PTS2,MarkerBit3PTS2,ControlBitsDTS,MarkerBit1DTS,MarkerBit2DTS,MarkerBit3DTS,SizeMismatch
PES WARNING: For PID 0194 DVB/ATSC unconform PES formating detected: PSCPrefix,StreamType,Scrambled,ControlBitsHd,ControlBitsPTS,MarkerBit1PTS,MarkerBit2PTS,MarkerBit3PTS,ControlBitsPTS2,MarkerBit1PTS2,MarkerBit2PTS2,MarkerBit3PTS2,ControlBitsDTS,MarkerBit1DTS,MarkerBit2DTS,MarkerBit3DTS,SizeMismatch

---------  NAL Unit Type Statistic  ---------
Slices                 : 260438
    I-Slices           : 0
    P-Slices           : 36169
    B-Slices           : 224269
    SP-Slices          : 0
    SI-Slices          : 0
Data Partition A       : 0
Data Partition B       : 0
Data Partition A       : 0
IDR Picture            : 11216
SEI                    : 45277
Sequence Parameter Set : 1870
Picture Parameter Set  : 1910
AUD                    : 45277
End of Sequence        : 0
End of Stream          : 0
Filler                 : 35719
Slices                 : 0
Seq. Param. Set Ext.   : 0

H264 filler data: 1,7% [Netto]

Cutted pakets at the beginning: 886076
Cutted pakets at the end: 0
Discarded pakets (Filler data): 104761 = 1,5% [Brutto]
Discarded pakets (to synch audio/video): 95

PID stream sizes
$00A2: 1,1 GB
$0194: 88,7 MB

ERRORS : 19
WARNINGS : 13

Speed: 17,4 MBytes/sec
Duration: 00:01:13

[Cypheros]

Thanks for the log. I can see that the recording has no PMT and only one video stream and one audio stream. After 00:31:26.089 the stream seems to be encrypted or invalid. It seems to be a very special recording. What channel is that?

At which time you get async audio/video for this file?

[barbatrukko]

hi,
i don't remember now the source of the stream (but the stream i think is from skyHD or raiHD ).
I try to know if the problem is related to error in decoding (maybe sometime some block of stream are not well decoded) or maybe is a problem of bandwidth (maybe device transfeRate of pendrive or hdd is not enough for this stream).
Based on your experience you think is possible the second option (tRate problem on recording to media)? But if this second option is true, why error on audio and not on video? My pendrive are very fast.

The file ". Ts" also after errors maintains the synchronism. Possible that there is no way to fix it so that you can demux without lost syncronization?

[Cypheros]

Video stream doesn't show so many errors because the video stream has no length information or CRC to check. But if the audio streams have errors, there are the same number of errors in the video stream.

You could try to cut out the areas with increased number of errors but the conversion into another container format will most likely still show some kind of problems.

[barbatrukko]

OK. now understand why I have many error on audio and few on video.

What about your experience? What is more likely about the problem?
pendrive Transfer rate too low or
problem about decripting of stream?

[Cypheros]

You can check the "real" write speed of your pendrive with the disk tool from TS-Doctor. Often the unbuffered write speed of this drives are very disappointing, especially if they are fragmentet. But a good receiver/recorder should display a warning if the drive is too slow.

[attachimg=1]