Fit many replicas in parallel

Created by: scarlehoff

A rebase for #1039 seemed way more complicated than manually porting the changes so I did that.

Missing: a few review comments that I still need to implement and ensuring I haven't broken anything along the way.