Automation

This team will implement automated analyses to investigate differences between manual and automated coding. Each Lead Replicating Lab will consider whether additional blinding is required during the analysis; e.g., by having manual analyses conducted by researchers who are blind with respect to the experimental conditions. Such blinded analyses will need to be reported as such in the replication attempt. The replicators will be expected to execute the previously agreed analysis script, which will provide an effect size for the meta-analysis. Preprocessed data will be provided to the Lead Replicating Lab for supplementary analyses of the aggregated dataset.

Analysis conducted by Replication Labs followed the respective analysis protocols compared with the automatic analysis developed by a group of analysts. This will provide a test of how analytical decisions such as manual or algorithmic artifact removal, selection of regions of interest can affect reproducibility.