Version 41 of Test Suite Log

Updated 2016-02-22 12:45:44 by oehhar

Test Suite Log

HaO I want to document test suite failures when running the test suite here. Others are invited to contribute.

The purpose of the page is to find any test suite differences when new versions are tested.

Tcl

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

8.5.x have build option "threads".

Test8.5.19
fCmd-9.9fail
fCmd-9.11fail
filesystem-1.3fail
filesystem-1.4fail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

8.5.x have build option "threads".

Test8.4.208.5.148.5.158.5.168.5.178.5.188.6.08.6.18.6.28.6.38.6.4
filename-16.12fail(6)fail(6)
filename-16.13fail(6)fail(6)
filename-16.14failfail
filename-16.15failfail
filesystem-1.3failfailfailfailfailfailfailfailfailfail
filesystem-1.4failfailfailfailfailfailfailfailfailfail
filesystem-1.39failfail
filesystem-20.7fail
filesystem-20.8fail
iortrans-11.1failfailfail
iortrans-11.2failfailfail
socket-14.0failfail
winFCmd-6.1failfail(1)failfailfailfailfail(1)
winFCmd-6.9failfail(1)failfailfailfailfail(1)
winFCmd-6.13failfail(1)failfailfailfailfail(1)
winFCmd-9.3failfail(1)failfailfailfailfail(1)
winFCmd-12.6failfail(1)failfailfailfail
zlib-8.8fail
zlib-8.9fail(2)failfail
zlib-8.10fail(2)failfailfail
zlib-8.11fail(2)failfailfail
itcl delegatemethod-1.6afail(5)
sfbug-254failfail
sfbug-257failfail
itcl dtypemethod-1.6afail(5)
itcldmethod-1.6afail(5)
sqlite3:leapsecond.testfail
tdbc::odbc-15.2fail(3)fail(4)fail(4)
tdbc::odbc-15.3fail(3)fail(4)fail(4)
tdbc::odbc-15.4fail(3)fail(4)fail(4)
tdbc::odbc-15.5fail(3)fail(4)fail(4)
tdbc::odbc-15.6fail(3)fail(4)fail(4)
tdbc::odbc-20.1afail(4)fail(4)fail(4)
tdbc::odbc-21.2fail(4)fail(4)fail(4)
tdbc::odbc-22.3failfailfail
tdbc::odbc-25.1afail(4)fail(4)fail(4)
tdbc::odbc-27.1afail(4)fail(4)fail(4)
tdbc::odbc-27.2bfail(4)fail(4)fail(4)

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Failed only once with privileged user
  3. Transaction issues, probably due to driver
  4. Message: database is locked (5)
  5. Trivial test error, wrong error help message expected
  6. Test badly designed: failure due to existing folder C:/test

Tk

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

8.5.x have build option "threads".

Test8.5.19
winfont-2.7fail(1)
winfont-2.8fail(1)
winfont-2.9fail(1)

Remarks

  1. Probably due to system font changes in Win 8, does not fail for Vista and Win7

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.5.148.5.158.5.16/178.5.188.6.08.6.18.6.28.6.38.6.4
bind-15.23fail
bitmap-4.1fail
border-3.1fail
cursor-4.1fail
font-18.1fail
spinbox-21.1failfailfailfailfailfailfail
text-19.16failfailfail
textDisp-19.11.20failfailfail
textDisp-19.11.23failfailfail
textDisp-29.2failfailfailfailfailfail
textDisp-29.2.1failfailfailfailfailfail
textDisp-29.2.2failfailfailfailfailfail
textDisp-29.2.3failfailfailfailfailfail
textDisp-29.2.4failfailfailfailfailfail
textImage-3.2failfailfailfailfailfailfail
textTag-15.1failfailfailfail
winClipboard-1.2fail(2)fail(1)
winClipboard-1.4fail(2)fail(1)
winClipboard-1.5fail(2)fail(1)
winClipboard-1.6fail(1)
winClipboard-2.2fail(2)fail(1)
winWm-7.3fail
wm-attributes-1.5.1failfail
wm-attributes-1.5.2fail
wm-attributes-1.5.4fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'.
  2. As 1., but with error message 'couldn't open clipboard: Succesfully processed.' (translated from german).

Test Logs

I also archive (for me) the test log files build with:

nmake -f Makefile.vc test OPTS=threads TESTFLAGS="-verbose bte" > testlog_tcl8.6.2rc0.txt 2>&1

Drop me an E-Mail if you want to get them.