PreferenceTest can't randomize AB choice

[MeowAlienOwO]

Error Behaviour: Not able to randomize AB choice, it always represent as defined in test case.

In file beaqle.js line 1375,

    // create random file mapping if not yet done
    if (!this.TestState.FileMappings[TestIdx]) 
        this.TestState.FileMappings[TestIdx] = {"A": "", "B": ""};
       var RandFileNumber = Math.random();
      // ----- Highlight this line (line 1375)
      if (this.TestConfig.RandomizeFileOrder && RandFileNumber>0.5) { 
      // ----- end
           this.TestState.FileMappings[TestIdx].A = "B";
           this.TestState.FileMappings[TestIdx].B = "A";
       } else {
           this.TestState.FileMappings[TestIdx].A = "A";
           this.TestState.FileMappings[TestIdx].B = "B";
        }                
    }	

It seems a flag RandomizeFileOrder is set to decide whether to randomly shuffle AB choice or not, but I can't find where to enable it. According to the code there is nowhere to set the RandomiizeFileOrder object, as a consequence we can never randomize AB order.

As a temporary solution I deleted the RandomizeFileOrder part, but I think it should be a kind of config to let the user enable/disable randomly shuffle AB choice.

[v-nhandt21]

My solution is just set the flag RandomizeFileOrder to be True

[martinholters]

Yep, looks like that's how it is meant to be used, but needs to be documented.