If you live in a region where autoclaved aerated concrete is produced/distributed, you have a much more elegant solution than ICF.
Autoclaved aerated concrete has both mass and insulation built in through the fine pores throughout its structure. The blocks can be cut with the same equipment used for wood working, taking account that lots of dust is generated with power equipment. One builds walls much thicker than with regular concrete. Below grade I would not use AAC, there is no need since with just 2" of extruded insulation on the outside, there is minimal heat loss through regular concrete.
Inside the shell, one can do interior walls in AAC block too, just thinner. In areas like bathrooms, a cavity wall can be built to conceal all the plumbing. There are core drills to drill holes through the block and it is much faster than on regular concrete.
The acoustics of a home built with AAC or rammed earth are in no way comparable to any stick built home. I have not yet experienced a SIP home, but it will be damped too, but light rigid panels also make good membranes to transmit low frequencies.
I was in Weil Am Rhein in Germany when hurricane Lothar swept in on the 26th of December 1999. Winds peaked at over 200mph. Thousands of square miles of forest was blown down in seconds. A "few" buildings had their roofs blown off, generally in 1 piece. Many older buildings lost tiles from their roofs. The 3 storey home I was in lost about 15 tiles from the roof. Not a single window broke and the air was not filled with debris, like what one sees here in the US in tornados.