Much more nice than just see where the pictures were made, is to see how it looks in the Google Street View today.
Check the location street view of some famous album covers. Enjoy! You can find the links for the Google Street View spots to explore the areas. ;)
Physical Graffiti - Led Zeppelin (Google Street View Link)
Paul's Boutique - Beastie Boys (Google Street View Link)
(What's The Story) Morning Glory? - Oasis (Google Street View Link)
The Freewheelin' - Bob Dylan (Google Street View Link)
Animals - Pink Floyd (Google Stree View Link)
Abbey Road - The Beatles (Street view Here)
Dressed to Kill - Kiss (Google Street View Link)