Mimicking wall shell crumbling using in between particles bind relations and the famous Cebas Shape Collision dynamics engine. You can get away using Bullet physics which will give you a more responsive and fast simulation setup but at a cost of accuracy.