I guess it's no surprise the disciples pointed out the magnificent temple during their Jerusalem visit in Matthew 24. It likely did surprise them when the Master prophesied of the day when "There shall not be left here one stone upon another, that shall not be thrown down". How permanent those stones must have seemed to them then. I believe it was around 70 A.D. when the Roman Titus was responsible for fulfiling that very prophecy, as chronicled in the arch that bears his name in Rome.
Nothing on earth today is any more permanent. Nothing.