Removing crap is actually all too easy. Deleting the application removes the app. Deleting the Library/Application Support folder for it removes the preferences. If you want to get fancy, AppZapper will scrub all trace of it. That's way better than any "uninstaller" type app I've seen.
For a new install, it's pretty easy: Rip consumer apps out of dock, delete apps you'll never use, load in MacPorts, compile a bunch of stuff, runs some installer packages, set up your shell environment, tweak preferences in various apps. Done. Usually it's 2-3 hours tops and you're ready for anything.