Generally, yes. Make your software better first before releasing it and you won't need to make changes to it.

Want a new feature that you didn't have before? That's a new software product.

> or you're happy with A testing, but not A/B testing

I'm happy with testing when the user has explicitly opted-in for it.