A batch of eight is not eight single runs
Batch size changes the noise each sample gets. A batched call and eight parallel calls diverge, even with the same seeds. Know when that variance is harmless.
9 min read
Batch size changes the noise each sample gets. A batched call and eight parallel calls diverge, even with the same seeds. Know when that variance is harmless.