HaO I want to document test suite failures when running the test suite here. Others are invited to contribute.
The purpose of the page is to find any test suite differences when new versions are tested.
Tcl 8.4 and 8.5
Obsolate versions, press button to see report
Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads
Test
8.4.20
8.5.14
8.5.15
8.5.16
8.5.17
8.5.18
filename-16.12
fail(2)
filename-16.13
fail(2)
filename-16.14
fail
filename-16.15
fail
filesystem-1.3
fail
fail
fail
fail
fail
filesystem-1.4
fail
fail
fail
fail
fail
filesystem-1.39
fail
filesystem-20.7
fail
filesystem-20.8
fail
iortrans-11.1
iortrans-11.2
socket-14.0
winFCmd-6.1
fail
fail(1)
fail
fail
fail
fail
winFCmd-6.9
fail
fail(1)
fail
fail
fail
fail
winFCmd-6.13
fail
fail(1)
fail
fail
fail
fail
winFCmd-9.3
fail
fail(1)
fail
fail
fail
fail
winFCmd-12.6
fail
fail(1)
fail
fail
fail
fail
Remarks
Fails typically the first test run, repeating will not fail
Test badly designed: failure due to existing folder C:/test
Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads
Test
8.5.19
fCmd-9.9
fail
fCmd-9.11
fail
filesystem-1.3
fail
filesystem-1.4
fail
winFCmd-6.1
fail
winFCmd-6.9
fail
winFCmd-6.13
fail
winFCmd-9.3
fail
Tcl 8.6.x
Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc
Test
8.6.0
8.6.1
8.6.2
8.6.3
8.6.4
8.6.8
cmdAH-25.3.1
fail
filename-16.12
fail(6)
fail(6)
filename-16.13
fail(6)
fail(6)
filename-16.14
fail
filename-16.15
fail
filesystem-1.3
fail
fail
fail
fail
fail
filesystem-1.4
fail
fail
fail
fail
fail
filesystem-1.39
fail
iortrans-11.1
fail
fail
fail
fail
iortrans-11.2
fail
fail
fail
fail
socket-14.0
fail
fail
winFCmd-6.1
fail(1)
winFCmd-6.9
fail(1)
winFCmd-6.13
fail(1)
winFCmd-9.3
fail(1)
zlib-8.8
fail
zlib-8.9
fail(2)
fail
fail
zlib-8.10
fail(2)
fail
fail
fail
zlib-8.11
fail(2)
fail
fail
fail
itcl delegatemethod-1.6a
fail(5)
sfbug-254
fail(7)
fail(7)
fail(7)
sfbug-257
fail(7)
fail(7)
fail(7)
itcl dtypemethod-1.6a
fail(5)
itcldmethod-1.6a
fail(5)
sqlite3:leapsecond.test
fail
tdbc::odbc-15.2
fail(3)
fail(4)
fail(4)
tdbc::odbc-15.3
fail(3)
fail(4)
fail(4)
tdbc::odbc-15.4
fail(3)
fail(4)
fail(4)
tdbc::odbc-15.5
fail(3)
fail(4)
fail(4)
tdbc::odbc-15.6
fail(3)
fail(4)
fail(4)
tdbc::odbc-20.1a
fail(4)
fail(4)
fail(4)
tdbc::odbc-21.2
fail(4)
fail(4)
fail(4)
tdbc::odbc-22.3
fail
fail
fail
tdbc::odbc-25.1a
fail(4)
fail(4)
fail(4)
tdbc::odbc-27.1a
fail(4)
fail(4)
fail(4)
tdbc::odbc-27.2b
fail(4)
fail(4)
fail(4)
Remarks
Fails typically the first test run, repeating will not fail
Failed only once with privileged user
Transaction issues, probably due to driver
Message: database is locked (5)
Trivial test error, wrong error help message expected
Test badly designed: failure due to existing folder C:/test
Test badly designed: package not found
ITcl package load error in test environment.
Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc
Test
8.6.5
8.6.6
8.6.7
8.6.8
8.6.9
8.6.10
8.6.11-8.6.13
8.6.14-8.6.15(4)
chan-io-52.11
fail
cmdAH-25.3.1
fail
fail
fail
fail
fCmd-9.9
fail
fail
fail
fail
fCmd-9.11
fail
fail
fail
fail
filesystem-1.3
fail
filesystem-1.4
fail
http-4.14 (3)
fail
iortrans-11.1 (1)
fail
fail
fail
fail
iortrans-11.2 (1)
fail
fail
fail
fail
winFCmd-2.8
fail
fail
fail
fail
winFCmd-6.1
fail
winFCmd-6.9
fail
winFCmd-6.13
fail
winFCmd-9.3
fail
sfbug-254 (2)
fail
fail
fail
fail
fail
sfbug-257 (2)
fail
fail
fail
fail
fail
Remarks
Cleanup fails
ITcl package load error in test environment.
Explanation by Donal 2019-11-22 core list: "That test depends on whether the ISP is being “helpful” and doing crazy stuff like saying that unresolved DNS lookups resolve to their search page. Mine does that at home, and it's really irritating at times. But it's not Tcl's fault when the environment tells it lies… "
SQLite does not compile any more since TCL 8.6.14. Since 8.6.12, special patches were required to support this archaic compiler.
Tcl 8.7
Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc
Test
8.7a3
socket-14.11.0
fail
The package "cookiejar" is not installed. It may be copied manually from the source library folder to the target lib folder.
Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc
Test
8.7a5
socket-14.11.0
fail
winFCmd-6.1
fail
winFCmd-6.9
fail
winFCmd-6.13
fail
winFCmd-9.3
fail
Tcl 9.0
Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc
Test
9.0a3
9.0b1
9.0b2-9.0b3
socket-14.11.0
fail
fail
winFCmd-6.1
fail
winFCmd-6.9
fail
winFCmd-6.13
fail
winFCmd-9.3
fail
Tk 8.5
Obsolate version, press to see report
Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads
Test
8.5.14
8.5.15
8.5.16/17
8.5.18
bind-15.23
fail
bitmap-4.1
fail
border-3.1
fail
cursor-4.1
fail
font-18.1
fail
spinbox-21.1
fail
fail
fail
textDisp-29.2
fail
fail
fail
textDisp-29.2.1
fail
fail
fail
textDisp-29.2.2
fail
fail
fail
textDisp-29.2.3
fail
fail
fail
textDisp-29.2.4
fail
fail
fail
textImage-3.2
fail
fail
fail
textTag-15.1
fail
fail
fail
fail
winClipboard-1.2
fail(1)
winClipboard-1.4
fail(1)
winClipboard-1.5
fail(1)
winClipboard-2.2
fail(1)
wm-attributes-1.5.1
fail
Remarks
Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'couldn't open clipboard: Succesfully processed.' (translated from german).
Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads
Test
8.5.19
winfont-2.7
fail(1)
winfont-2.8
fail(1)
winfont-2.9
fail(1)
Remarks
Probably due to system font changes in Win 8, does not fail for Vista and Win7
Tk 8.6
Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc
Test
8.6.0
8.6.1
8.6.2
8.6.3
8.6.4,8.6.8
spinbox-21.1
fail
fail
fail
fail
text-19.16
fail
fail
fail
textDisp-19.11.20
fail
fail
fail
textDisp-19.11.23
fail
fail
fail
textDisp-29.2
fail
fail
fail
textDisp-29.2.1
fail
fail
fail
textDisp-29.2.2
fail
fail
fail
textDisp-29.2.3
fail
fail
fail
textDisp-29.2.4
fail
fail
fail
textImage-3.2
fail
fail
fail
fail
winClipboard-1.2
fail(1)
winClipboard-1.4
fail(1)
winClipboard-1.5
fail(1)
winClipboard-1.6
fail(1)
winClipboard-2.2
fail(1)
winWm-7.3
fail
wm-attributes-1.5.1
fail
wm-attributes-1.5.2
fail
wm-attributes-1.5.4
fail
Remarks
Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'.
fvogel: the winCLipboard tests are reliable, it's just that some can fail if another application grabbed the clipboard. See [L1 ].
HaO: thanks, Francois, correct. The application "UltraVNC" constantly grabbed the clipboard in my case.
Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc
Test
8.6.5-8.6.7
8.6.8-8.6.9
8.6.10-8.6.15
textTag-18.1
fail(1)
Remarks
This failure was discussed within Ticket Tk 69b48f427 . A recheck on 8.6.7 also showed that failure. Known reason is a Windows 10 change in Creator Fall (2018-03) update.
Tk 8.7
Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK 2003SP1, Makfile.vc
Test
8.7a3
canvText-20.1
fail
textDisp-3.1
fail
textDisp-22.6
fail
textDisp-22.7
fail
winfont-2.7
fail
Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc
Test
8.7a5 with TCL8.7a5
8.7a5 with TCL9.0a3
Tk8.7a5 has no test failures.
Tk 9.0
Windows 10 Pro 64 bit GER, MSVS2015 32bit Makfile.vc
Tk9.0b1-b3 have no test failures.
Test Logs
I also archive (for me) the test log files build with:
nmake -f Makefile.vc test TESTFLAGS="-verbose bte" > testlog_tcl9.0.0.txt 2>&1