Well, first of all, that camera movement is pretty confusing.
You don't want to confuse your audience, but to give them clear silhouette of what's going on, even if it's for a fracture of second.
Bad camera can take from a scene, as much as good camera can add to the scene.
Second, I think you need some bindings... right now, house brakes like disassembled lego parts, that just falls... House are stronger, tighter, and should crumble more... small parts yes - but also big parts (that you can do with clusters and physX bind).
But then again, camera lens is pretty narrow, so when you add here bunch of smoke (with some fluid sims), you'll probably won't see much of the destruction anyway,
so even this might work.. not sure.
Hope this help, and this is just my humble opinion.