Does this really happen often? I’m not saying it doesn’t, I’ve just heard the claim repeated often while never having seen it myself. Maybe because every project I’ve been on was far over-complicated rather under.

A small, crappy prototype would also go far in sussing out requirements. But I’ve generally not seen that included enough in the development process for most big corporate internet projects.