Just like the other non programming book on the list(Thinking Fast and Slow) GEB is a lot about perception to me.
Understanding that nothing is purely logical nor is it purely expressionistic; by pigeonholing your perception of any design whether it be Code, Math or Art to either Logic xor Expression you are blinding yourself
The other angle for GEB is design
I read GEB along with Design of Design years ago following my mentor at the times suggestion, I would highly recommend doing this.
Think of it as the Gödel, Escher, Bach, Brooks (Although Brook's writing style can be laborious at times)
Recognizing patterns in all design work helped my understand my own design process better.