[core][distributed] custom allreduce when pp size > 1 (#6117)

[core][distributed] custom allreduce when pp size > 1 (#6117) #13