Do this instead: disable your Element Fracture and Object Bind operators, and instead enable the object animation options in the Birth Objects operator (inherit position/rotation).
The fix for your current setup is setting the Object Bind sample to 'Face' instead of 'Hybrid'....when you have multiple low-res objects as input, the 'Hybrid' mode can accidentally bind your particles to the wrong part of the surface, resulting in the issues that you see.
The fix for your current setup is setting the Object Bind sample to 'Face' instead of 'Hybrid'....when you have multiple low-res objects as input, the 'Hybrid' mode can accidentally bind your particles to the wrong part of the surface, resulting in the issues that you see.