It's not the music, but it's the experience. It's something that's been lost in recent times, for the most part.
I have a large collection (circa 3,000 lps). For me, listening was seldom just about the music. The packging can set the scene. Take a Lemon Jelly lp - it folds out into 6 sides of beautiful hand craft art, before you get to the music.