Used to think the same way, still do to a certain degree, but I've mounted AC compressors outside in AAC blocks with regular concrete anchor bolts.
Same indoors hanging small stuff, smaller holes for the anchors than you would normally use for concrete/brick and no problems.
Stuff is just as soft as drywall back home and we hang shit off it all day long.
The cost is also semi negated by how uniform they are and how little mortar you use. They also go up way faster.
Overall I would probably use AAC but a double wall with air-gap. Doing the same with red brick is heavy as fuuuuuk.
As as far as the OP, think about where you are. If it sounds retarded then it probably is.