Let's see. I moved last summer, from a place I lived in for seven years. Check. I'm married, kid on the way, I knew my neighbors, and I have family nearby. You were so close. (I do make over the median income, so you did get that one.)
If your landlord raises their rates to double the market value, move. If you don't, that just means you're doing it wrong.
So you're telling me that in one weekend with one truck, you packed everything for a family, moved it, unpacked it, and had total expenses of a few hundred bucks? Congrats on being a minimalist. When I see most people do it, though, they take a couple of months of spare time to prep and months more to get everything situated and recover.
Yes, sure, if the rent is doubled, one should probably move despite the hassle. But the point is that landlords can take advantage of the asymmetry in cost/difficulty of changing places to hike rents. Nobody would move because the landlord was charging them $1/yr above what they could pay elsewhere. Most would move if it were double. The landlord's advantage is somewhere in between.
If your landlord raises their rates to double the market value, move. If you don't, that just means you're doing it wrong.