Matroska Test Suite

[bastik]

There is a package to check players for compatibility. It's the first wave.


This set of files is as much of tool for developers to make sure they have correct Matroska support in their product as for users to make sure the players they have (sometimes paid for, and advertised with Matroska support) is actually supporting Matroska correctly and will play any standard file (provided it can handle the codec).



Test Suite News ([Only registered and activated users can see links])

Test Suite Info ([Only registered and activated users can see links])

Nice thing to test.


The 8 files included in this set are:

* test1.mkv : Basic file
* test2.mkv : Non default timecodescale & aspect ratio
* test3.mkv : Header stripping & standard block
* test4.mkv : Live stream recording
* test5.mkv : Multiple audio/subtitles
* test6.mkv : Different EBML head sizes & cue-less seeking
* test7.mkv : Extra unknown/junk elements & damaged
* test8.mkv : Audio gap



I will post the results below.

[bastik]

Summary:

<> The KMPlayer + Haali's Media Splitter = all samples play fine (beside test4.mkv)
<> The KMPlayer + internal splitter = Sample 2 has a wrong AR and seek info is wrong, test4 wont play, test7 aborts playback
<> The KMPlayer + Gabest = Sample 2 has wrong AR and seek info is wrong, test4 wont play, (should be preferred as it plays damaged files or such that contain junk, see note below too)

Note with internal splitter there's still is a bug with header removal compression. Not on mp3 files but on AC3 files.

Longer Description of the actual test:
(sorted by samples/test files)


Sample 1: an ordinary matroska file
All splitters split the file perfectly. They should because there is nothing special.

Sample 2: Non default timecodescale & AR
Haali's Splitter makes KMPlayer report the correct length, and the file is fully seek-able. The AR is absolute correct.
The internal splitter makes KMPlayer report an incorrect length. The file cant be seeked correctly. The AR is wrong.
Gabest makes KMPlayer report an incorrect length. The file cant be seeked correctly. The AR is wrong.

Sample 3: Stripped Headers & Standard Block
All splitters split the file and it gets played correctly. (Only the internal splitter has a problem with stripped headers with AC3 at least, but it doesn't occur with mp3)

Sample 4: Live stream recording (there's no duration etc)
Haali's Media Splitter doesn't get loaded.
Internal Splitter no video and no audio.
Gabest no video and no audio.

Sample 5: Multiple audio and subtitle streams
Haali's Media Splitter shows the different streams and it's possible to switch between them. This works as well as with the internal switching method as it does with Haali's Menu.
Internal Splitter stream switching works.
Gabest stream switching works.

Sample 6: Different EBML head sizes & cue-less seeking
All splitters split the file correctly. The file can be seeked properly.

Sample 7: Extra unknown/junk elements & damaged
Haali's Media Splitter skips the junk and continues playback.
The internal splitter aborts playback when it reads the junk.
Gabest skips the junk and continues playback.

Sample 8: Audio Gap
All splitters continue playback of audio and video.


Please test the files on your own. I'm going to report some problems as bug, but wait for feedback.


Please test other players you use and report the results to it's developers and the makers of matroska.
Should you find other problems related to matroska please file bug reports for The KMPlayer.

[tramp]

thank you.

[bastik]

Build 1440

Sample 1: No change, all splitters pass.
Sample 2: No change, Haali passes, Internal and Gabest fail.
Sample 3: All splitters pass. Now even AC3 is no problem for the internal splitter.
Sample 4: All splitters or the player fail. There's no video/audio or there is nothing found to decode the stream. (EDIT: VLC can play live files, created with "mkclean" (--live). Well it's not DirectShow based, but as reference it should work) (PotPlayer internal splitter works for splitting, but it closes a live file after two seconds.)
Sample 5: No change, all splitters pass.
Sample 6: No change, all splitters pass.
Sample 7: The internal splitter still aborts playback, Gabest and Haali pass.
Sample 8: All splitters pass.

[bastik]

2011-06-02 - w1_1: fix test2.mkv with had a duration not based on TimecodeScale

The test files got updated due to an issue with test2.mkv! TimecodeScale should be set according to the specs, but it was not.

This changes the test results for test2.mkv to:
Sample 2: Non default timecodescale & AR
Haali's Splitter makes KMPlayer report the correct length, and the file is fully seek-able. The AR is absolute correct.
The internal splitter makes KMPlayer report the correct length. The file is fully seek-able. The AR is wrong.
Gabest makes KMPlayer report the correct length. The file is fully seek-able. The AR is wrong.

I uploaded test2.mkv to avoid that one who has all files needs to download all of them. [Only registered and activated users can see links]