Intermittent test errors on CHICKEN
I have observed intermittent test errors on CHICKEN. It feels like an error occurs in roughly 1 out of 20 runs of the test suite. The errors have (I think) all been in tests related to strings, but it is not always the same test that has an error. Some example logs are pasted below.
It is unknown whether these errors are actually related, because the test infrastructure on CHICKEN does not print the error message. (Doh.
Observed 2015-05-02 (and again 2015-06-13):
Cloje 0.1.0
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 142 tests containing 2440 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
ERROR in (test-string/last-index-of)
expected: (= 2 (string/last-index-of "foo" "o"))
actual: #<condition: (exn)>
Ran 142 tests containing 2440 assertions.
0 failures, 1 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2
Observed 2015-05-17:
Cloje 0.2.0-dev
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 148 tests containing 2555 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
ERROR in (test-string/replace)
expected: (= "yay-yay" (string/replace (quote oy-oy) "o" "ya"))
actual: #<condition: (exn)>
Ran 148 tests containing 2555 assertions.
0 failures, 1 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2
Observed 2015-06-15:
Cloje 0.2.0-dev
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 155 tests containing 2830 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
FAIL in (test-string/last-index-of)
expected: (= 1 (string/last-index-of "foo" "oo"))
actual: (not (= 1 2))
Ran 155 tests containing 2830 assertions.
1 failures, 0 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2
Observed 2015-07-15:
Cloje 0.3.0-dev
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 158 tests containing 3880 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
FAIL in (test-string/last-index-of)
expected: (= 2 (string/last-index-of "foo" "o"))
actual: (not (= 2 3))
Ran 158 tests containing 3880 assertions.
1 failures, 0 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2
Observed 2015-07-18:
Cloje 0.3.0-dev
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 162 tests containing 3966 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
ERROR in (test-string/replace)
expected: (= "muamuamua" (string/replace "hahaha" "h" "mu"))
actual: #<condition: (exn)>
Ran 162 tests containing 3966 assertions.
0 failures, 1 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2
Observed 2015-07-19 (and again 2015-07-20):
Cloje 0.3.0-dev
Updated docs/exports.md
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C racket test
racket -t tests.rkt
Ran 162 tests containing 4165 assertions.
0 failures, 0 errors.
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C chicken test
cd tests && csi -D load-local-cloje -s run.scm
ERROR in (test-string/replace)
expected: (= (string/replace (str (quote oy-oy:)) "o" "ya") (string/replace (quote oy-oy:) "o" "ya"))
actual: #<condition: (exn)>
Ran 162 tests containing 4165 assertions.
0 failures, 1 errors.
make[1]: *** [test] Error 1
make: *** [test] Error 2