[HaO] I want to document test suite failures when running the test suite here. Others are invited to contribute. The purpose of the page is to find any test suite differences when new versions are tested. **Tcl 8.4 and 8.5** ***Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads*** %|Test|8.4.20|8.5.14|8.5.15|8.5.16|8.5.17|8.5.18|% &|filename-16.12||||||fail(2)|& &|filename-16.13||||||fail(2)|& &|filename-16.14||||fail|||& &|filename-16.15||||fail|||& &|filesystem-1.3||fail|fail|fail|fail|fail|& &|filesystem-1.4||fail|fail|fail|fail|fail|& &|filesystem-1.39||||fail|||& &|filesystem-20.7|fail||||||& &|filesystem-20.8|fail||||||& &|iortrans-11.1|||||||& &|iortrans-11.2|||||||& &|socket-14.0|||||||& &|winFCmd-6.1|fail|fail(1)|fail|fail|fail|fail|& &|winFCmd-6.9|fail|fail(1)|fail|fail|fail|fail|& &|winFCmd-6.13|fail|fail(1)|fail|fail|fail|fail|& &|winFCmd-9.3|fail|fail(1)|fail|fail|fail|fail|& &|winFCmd-12.6|fail|fail(1)|fail|fail|fail|fail|& ****Remarks**** 1. Fails typically the first test run, repeating will not fail 1. Test badly designed: failure due to existing folder C:/test ***Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option: threads*** %|Test|8.5.19|% &|fCmd-9.9|fail|& &|fCmd-9.11|fail|& &|filesystem-1.3|fail|& &|filesystem-1.4|fail|& &|winFCmd-6.1|fail|& &|winFCmd-6.9|fail|& &|winFCmd-6.13|fail|& &|winFCmd-9.3|fail|& **Tcl 8.6.x** ***Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc*** %|Test|8.6.0|8.6.1|8.6.2|8.6.3|8.6.4|8.6.8|% &|cmdAH-25.3.1||||||fail|& &|filename-16.12|||||fail(6)|fail(6)|& &|filename-16.13|||||fail(6)|fail(6)|& &|filename-16.14|||fail||||& &|filename-16.15|||fail||||& &|filesystem-1.3|fail|fail|fail|fail|fail||& &|filesystem-1.4|fail|fail|fail|fail|fail||& &|filesystem-1.39|||fail||||& &|iortrans-11.1|||fail|fail|fail|fail|& &|iortrans-11.2|||fail|fail|fail|fail|& &|socket-14.0|fail|fail|||||& &|winFCmd-6.1|fail(1)||||||& &|winFCmd-6.9|fail(1)||||||& &|winFCmd-6.13|fail(1)||||||& &|winFCmd-9.3|fail(1)||||||& &|zlib-8.8|||||fail||& &|zlib-8.9|fail(2)|fail|||fail||& &|zlib-8.10|fail(2)|fail||fail|fail||& &|zlib-8.11|fail(2)|fail||fail|fail||& &|itcl delegatemethod-1.6a|||fail(5)||||& &|sfbug-254||||fail(7)|fail(7)|fail(7)|& &|sfbug-257||||fail(7)|fail(7)|fail(7)|& &|itcl dtypemethod-1.6a|||fail(5)||||& &|itcldmethod-1.6a|||fail(5)||||& &|sqlite3:leapsecond.test||||fail|||& &|tdbc::odbc-15.2|fail(3)|fail(4)|fail(4)||||& &|tdbc::odbc-15.3|fail(3)|fail(4)|fail(4)||||& &|tdbc::odbc-15.4|fail(3)|fail(4)|fail(4)||||& &|tdbc::odbc-15.5|fail(3)|fail(4)|fail(4)||||& &|tdbc::odbc-15.6|fail(3)|fail(4)|fail(4)||||& &|tdbc::odbc-20.1a|fail(4)|fail(4)|fail(4)||||& &|tdbc::odbc-21.2|fail(4)|fail(4)|fail(4)||||& &|tdbc::odbc-22.3|fail|fail|fail||||& &|tdbc::odbc-25.1a|fail(4)|fail(4)|fail(4)||||& &|tdbc::odbc-27.1a|fail(4)|fail(4)|fail(4)||||& &|tdbc::odbc-27.2b|fail(4)|fail(4)|fail(4)||||& ****Remarks**** 1. Fails typically the first test run, repeating will not fail 1. Failed only once with privileged user 1. Transaction issues, probably due to driver 1. Message: database is locked (5) 1. Trivial test error, wrong error help message expected 1. Test badly designed: failure due to existing folder C:/test 1. Test badly designed: package not found 1. ITcl package load error in test environment. ***Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc*** %|Test|8.6.5|8.6.6|8.6.7|8.6.8|8.6.9|8.6.10|8.6.11|% &|chan-io-52.11||fail||||||& &|cmdAH-25.3.1||fail|fail|fail|fail|||& &|fCmd-9.9|fail|fail|fail|fail||||& &|fCmd-9.11|fail|fail|fail|fail||||& &|filesystem-1.3|fail|||||||& &|filesystem-1.4|fail|||||||& &|http-4.14 (3)||||||fail||& &|iortrans-11.1 (1)|fail|fail|fail|fail||||& &|iortrans-11.2 (1)|fail|fail|fail|fail||||& &|winFCmd-2.8|fail|fail|fail|fail||||& &|winFCmd-6.1|||||||fail|& &|winFCmd-6.9|||||||fail|& &|winFCmd-6.13|||||||fail|& &|winFCmd-9.3|||||||fail|& &|sfbug-254 (2)|fail|fail|fail|fail|fail|||& &|sfbug-257 (2)|fail|fail|fail|fail|fail|||& ****Remarks**** 1. Cleanup fails 1. ITcl package load error in test environment. 1. Explanation by Donal 2019-11-22 core list: "That test depends on whether the ISP is being “helpful” and doing crazy stuff like saying that unresolved DNS lookups resolve to their search page. Mine does that at home, and it's really irritating at times. But it's not Tcl's fault when the environment tells it lies… " SQLite needs the following patch to compile: ====== +++ tcl8.6.11/pkgs/sqlite3.34.0/compat/sqlite3/sqlite3.c @@ -32245,7 +32245,7 @@ int i; for(i=0; sqlite3Isdigit(z[i]); i++){ v = v*10 + z[i] - '0'; - if( v>(u32)-1 ){ *pI = 0; return 0; } + if( v>4294967296LL ){ *pI = 0; return 0; } } if( i==0 || z[i]!=0 ){ *pI = 0; return 0; } *pI = (u32)v; ====== **Tcl 8.7** ***Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK for Windows Server 2003 R2, Makfile.vc*** %|Test|8.7a3|% &|socket-14.11.0|fail|& The package "cookiejar" is not installed. It may be copied manually from the source library folder to the target lib folder. **Tk 8.5** ***Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads*** %|Test|8.5.14|8.5.15|8.5.16/17|8.5.18|% &|bind-15.23|||fail||& &|bitmap-4.1|||fail||& &|border-3.1|||fail||& &|cursor-4.1|||fail||& &|font-18.1|||fail||& &|spinbox-21.1|fail|fail|fail||& &|textDisp-29.2|fail|fail|fail||& &|textDisp-29.2.1|fail|fail|fail||& &|textDisp-29.2.2|fail|fail|fail||& &|textDisp-29.2.3|fail|fail|fail||& &|textDisp-29.2.4|fail|fail|fail||& &|textImage-3.2|fail|fail|fail||& &|textTag-15.1|fail|fail|fail|fail|& &|winClipboard-1.2||fail(1)|||& &|winClipboard-1.4||fail(1)|||& &|winClipboard-1.5||fail(1)|||& &|winClipboard-2.2||fail(1)|||& &|wm-attributes-1.5.1||fail|||& ****Remarks**** 1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'couldn't open clipboard: Succesfully processed.' (translated from german). ***Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc, build option:threads*** %|Test|8.5.19|% &|winfont-2.7|fail(1)|& &|winfont-2.8|fail(1)|& &|winfont-2.9|fail(1)|& ****Remarks**** 1. Probably due to system font changes in Win 8, does not fail for Vista and Win7 **Tk 8.6** ***Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc*** %|Test|8.6.0|8.6.1|8.6.2|8.6.3|8.6.4,8.6.8|% &|spinbox-21.1|fail|fail|fail|fail||& &|text-19.16|fail|fail|fail|||& &|textDisp-19.11.20|fail|fail|fail|||& &|textDisp-19.11.23|fail|fail|fail|||& &|textDisp-29.2|fail|fail|fail|||& &|textDisp-29.2.1|fail|fail|fail|||& &|textDisp-29.2.2|fail|fail|fail|||& &|textDisp-29.2.3|fail|fail|fail|||& &|textDisp-29.2.4|fail|fail|fail|||& &|textImage-3.2|fail|fail|fail|fail||& &|winClipboard-1.2||fail(1)||||& &|winClipboard-1.4||fail(1)||||& &|winClipboard-1.5||fail(1)||||& &|winClipboard-1.6||fail(1)||||& &|winClipboard-2.2||fail(1)||||& &|winWm-7.3|fail|||||& &|wm-attributes-1.5.1|fail|||||& &|wm-attributes-1.5.2|fail|||||& &|wm-attributes-1.5.4|fail|||||& ****Remarks**** 1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'. [fvogel]: the winCLipboard tests are reliable, it's just that some can fail if another application grabbed the clipboard. See [https://core.tcl-lang.org/tk/tktview/9b0f3ee54e431ae7bc301525b599e4320d5d47f2]. ***Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK for Windows Server 2003 R2, Makfile.vc*** %|Test|8.6.5-8.6.7|8.6.8-8.6.9|8.6.10-8.6.11|% &|textTag-18.1||fail(1)||& ****Remarks**** 1. This failure was discussed within Ticket [https://core.tcl.tk/tk/info/69b48f427e94899a%|%Tk 69b48f427%|%]. A recheck on 8.6.7 also showed that failure. Known reason is a Windows 10 change in Creator Fall (2018-03) update. **Tk 8.7** ***Windows 10 Pro 64 bit GER, MSVC6++ 32bit, Platform SDK 2003SP1, Makfile.vc*** %|Test|8.7a3|% &|canvText-20.1|fail|& &|textDisp-3.1|fail|& &|textDisp-22.6|fail|& &|textDisp-22.7|fail|& &|winfont-2.7|fail|& **Test Logs** I also archive (for me) the test log files build with: ======none nmake -f Makefile.vc test TESTFLAGS="-verbose bte" > testlog_tcl8.6.10.txt 2>&1 ====== Drop me an E-Mail if you want to get them. <> Development