Test Suite Log

HaO I want to document test suite failures when running the test suite here. Others are invited to contribute.

The purpose of the page is to find any test suite differences when new versions are tested.

Tcl 8.4 and 8.5

  Obsolate versions, press button to see report

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads

Test8.4.208.5.148.5.158.5.168.5.178.5.18
filename-16.12fail(2)
filename-16.13fail(2)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
filesystem-20.7fail
filesystem-20.8fail
iortrans-11.1
iortrans-11.2
socket-14.0
winFCmd-6.1failfail(1)failfailfailfail
winFCmd-6.9failfail(1)failfailfailfail
winFCmd-6.13failfail(1)failfailfailfail
winFCmd-9.3failfail(1)failfailfailfail
winFCmd-12.6failfail(1)failfailfailfail

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Test badly designed: failure due to existing folder C:/test

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads

Test8.5.19
fCmd-9.9fail
fCmd-9.11fail
filesystem-1.3fail
filesystem-1.4fail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Tcl 8.6.x

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.48.6.8
cmdAH-25.3.1fail
filename-16.12fail(6)fail(6)
filename-16.13fail(6)fail(6)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
iortrans-11.1failfailfailfail
iortrans-11.2failfailfailfail
socket-14.0failfail
winFCmd-6.1fail(1)
winFCmd-6.9fail(1)
winFCmd-6.13fail(1)
winFCmd-9.3fail(1)
zlib-8.8fail
zlib-8.9fail(2)failfail
zlib-8.10fail(2)failfailfail
zlib-8.11fail(2)failfailfail
itcl delegatemethod-1.6afail(5)
sfbug-254fail(7)fail(7)fail(7)
sfbug-257fail(7)fail(7)fail(7)
itcl dtypemethod-1.6afail(5)
itcldmethod-1.6afail(5)
sqlite3:leapsecond.testfail
tdbc::odbc-15.2fail(3)fail(4)fail(4)
tdbc::odbc-15.3fail(3)fail(4)fail(4)
tdbc::odbc-15.4fail(3)fail(4)fail(4)
tdbc::odbc-15.5fail(3)fail(4)fail(4)
tdbc::odbc-15.6fail(3)fail(4)fail(4)
tdbc::odbc-20.1afail(4)fail(4)fail(4)
tdbc::odbc-21.2fail(4)fail(4)fail(4)
tdbc::odbc-22.3failfailfail
tdbc::odbc-25.1afail(4)fail(4)fail(4)
tdbc::odbc-27.1afail(4)fail(4)fail(4)
tdbc::odbc-27.2bfail(4)fail(4)fail(4)

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Failed only once with privileged user
  3. Transaction issues, probably due to driver
  4. Message: database is locked (5)
  5. Trivial test error, wrong error help message expected
  6. Test badly designed: failure due to existing folder C:/test
  7. Test badly designed: package not found
  8. ITcl package load error in test environment.

Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc

Test8.6.58.6.68.6.78.6.88.6.98.6.108.6.11-8.6.138.6.14-8.6.15(4)
chan-io-52.11fail
cmdAH-25.3.1failfailfailfail
fCmd-9.9failfailfailfail
fCmd-9.11failfailfailfail
filesystem-1.3fail
filesystem-1.4fail
http-4.14 (3)fail
iortrans-11.1 (1)failfailfailfail
iortrans-11.2 (1)failfailfailfail
winFCmd-2.8failfailfailfail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail
sfbug-254 (2)failfailfailfailfail
sfbug-257 (2)failfailfailfailfail

Remarks

  1. Cleanup fails
  2. ITcl package load error in test environment.
  3. Explanation by Donal 2019-11-22 core list: "That test depends on whether the ISP is being “helpful” and doing crazy stuff like saying that unresolved DNS lookups resolve to their search page. Mine does that at home, and it's really irritating at times. But it's not Tcl's fault when the environment tells it lies… "
  4. SQLite does not compile any more since TCL 8.6.14. Since 8.6.12, special patches were required to support this archaic compiler.

Tcl 8.7

Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc

Test8.7a3
socket-14.11.0fail

The package "cookiejar" is not installed. It may be copied manually from the source library folder to the target lib folder.

Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc

Test8.7a5
socket-14.11.0fail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Tcl 9.0

Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc

Test9.0a39.0b19.0b2,9.0b3,9.0.0
socket-14.11.0failfail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Tk 8.5

  Obsolate version, press to see report

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads

Test8.5.148.5.158.5.16/178.5.18
bind-15.23fail
bitmap-4.1fail
border-3.1fail
cursor-4.1fail
font-18.1fail
spinbox-21.1failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfail
textTag-15.1failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-2.2fail(1)
wm-attributes-1.5.1fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'couldn't open clipboard: Succesfully processed.' (translated from german).

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads

Test8.5.19
winfont-2.7fail(1)
winfont-2.8fail(1)
winfont-2.9fail(1)

Remarks

  1. Probably due to system font changes in Win 8, does not fail for Vista and Win7

Tk 8.6

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.4,8.6.8
spinbox-21.1failfailfailfail
text-19.16failfailfail
textDisp-19.11.20failfailfail
textDisp-19.11.23failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-1.6fail(1)
winClipboard-2.2fail(1)
winWm-7.3fail
wm-attributes-1.5.1fail
wm-attributes-1.5.2fail
wm-attributes-1.5.4fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'.

fvogel: the winCLipboard tests are reliable, it's just that some can fail if another application grabbed the clipboard. See [L1 ].

HaO: thanks, Francois, correct. The application "UltraVNC" constantly grabbed the clipboard in my case.

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc

Test8.6.5-8.6.78.6.8-8.6.98.6.10-8.6.15
textTag-18.1fail(1)

Remarks

  1. This failure was discussed within Ticket Tk 69b48f427 . A recheck on 8.6.7 also showed that failure. Known reason is a Windows 10 change in Creator Fall (2018-03) update.

Tk 8.7

Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK 2003SP1, Makfile.vc

Test8.7a3
canvText-20.1fail
textDisp-3.1fail
textDisp-22.6fail
textDisp-22.7fail
winfont-2.7fail

Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc

Test8.7a5 with TCL8.7a58.7a5 with TCL9.0a3

Tk8.7a5 has no test failures.

Tk 9.0

Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc

Tk9.0b1, 9.0b2, 9.0b3 and 9.0.0 have no test failures.

Test Logs

I also archive (for me) the test log files build with:

nmake -f Makefile.vc test TESTFLAGS="-verbose bte" > testlog_tcl9.0.0.txt 2>&1

Drop me an E-Mail if you want to get them.

Category Development
Updated 2024-10-14 16:56:26