Back to the main page.

Bug 1771 - test_tutorial_clusterpermutationfreq only passes on odd revisions... a.k.a. 'the pulsar'

Status	CLOSED WONTFIX
Reported	2012-10-09 12:27:00 +0200
Modified	2019-08-10 11:56:04 +0200
Product:	FieldTrip
Component:	core
Version:	unspecified
Hardware:	PC
Operating System:	Linux
Importance:	P2 critical
Assigned to:
URL:
Tags:
Depends on:
Blocks:
See also:

Boris Reuderink - 2012-10-09 12:27:28 +0200

Created attachment 346 screen shot of test outcome history. Somehow, the test_tutorial_clusterpermutationfreq shows an alternating pattern of failing and passing. See also the attached screenshot. I find this very, very odd.

Boris Reuderink - 2012-10-09 12:35:36 +0200

Okay, I just confirmed this on my Windows computer. In revision 6709 this test passes, in revision 6710 it fails again. The only changes are unrelated (?) test scripts. According to the output of the script, the p-values are really different. I feel that the low probability of this pattern happening by chance warrants an upgrade of the severity of this bug.

Boris Reuderink - 2012-10-11 14:53:40 +0200

This test has now been passing for a few revisions. Still, I don't have a clue how this could happen...

Boris Reuderink - 2012-10-25 14:57:34 +0200

Ok, now it passes all the time. Odd.

Jan-Mathijs Schoffelen - 2012-11-07 13:41:43 +0100

Robert Oostenveld - 2019-08-10 11:52:08 +0200

This closes a whole series of bugs that have been resolved (either FIXED/WONTFIX/INVALID) for quite some time. If you disagree, please file a new issue describing the issue on https://github.com/fieldtrip/fieldtrip/issues.