KMP build 1431 test - How to improve test?

[bastik]

I've done some tests. On 1431 only. I want to test newer builds in the same way. Any suggestions to improve/exceed the test?

System: Windows XP (SP3)(32bit)latest patches installed
CPU: AMD Athlon 64 X2 Dual Core Processor 4200+ (2.2)
ATI Radeon X1650

KMP Version:2.9.3.1431

CPU-usage: low

notes: DVDs were mounted, no drive test. Files were stored on hard disk.
Settings stored to registry.

file types audio: .mp3; .wav; .acc; .ac3
file types video: .avi; .flv; .mpg; .mpeg; .divx; .xvid; .mkv; .m4v

normal video playback: PASS
HQ video playback: PASS (752X576;1280X720)

test capture modes
-audio: PASS
-video: PASS

try to open file with wrong extension: PASS
try to open unsupported files: PASS (player stays open, no crash)

randomly seek (jump through) audio: PASS
randomly seek (jump through) video: PASS
randomly seek (jump through) DVD: PASS

change skin during playback
-audio: PASS
-video: PASS
-dvd: PASS

jump randomly through playlist: PASS

test broken files: PASS (.avi)
test reopen file during playback: PASS

test Ctrl+TAB dump: PASS except detection memory correctly (more than 2 GB)

open drive (unmount in this case) while playing (DVD): PASS (Playback stops, no crash)
end kmp while file is playing: PASS
(the normal way I end kmp)

test desktop mode
-audio (visual, slideshow, build-in): PASS
-video: PASS
-dvd: PASS

shutdown test: PASS

DVD
change language during playback
-audio: PASS
-subtitle: PASS

DVD
jump through menus: PASS

test internetstreams: PASS

playback test (audio/video)
-shorttime: PASS
-midtime: PASS
-longtime: skipped/half done

skip files fast
-audio: PASS
-video: PASS

Summary: All tests passed (expected results)
Final note: Player just crashed once, while playing audio files in playlist.
No reason found. Crash without error message. PC was in stand-by mode before. Couldn't reproduce it.

I don't have a TV-card to test.

[mouse]

Wow, your testing method is quiet well organized. All passed? General test shows an expected result. Cool. :)

We need to grab the list of known problems and manage it in one thread.

[bastik]

your testing method is quiet well organized. All passed? General test shows an expected result.

Maybe I should sort it a bit more. It works like it is now I think.

Passed? Player froze caused by pressing "forward seek" and "backward seek" at the same time. (expected / accepted) "Restore window to it's last size" and "restore window to it's last position" are activated. If the shutdown function is used (experienced in video mode {always on top}) the player moves the windows and resizes it (makes it smaller) to show the count down. On next system start and player start the window is as small as KMP set it. This is also accepted.

The preset wasn't fresh. I should use the default to make every test reproduceable.