There are many ways in which one can buy music these days. Anyone can buy mp3 files over the Internet. This is a trend that is growing fast, as it can sometimes be cheaper and more practical than buying CDs. Buying online means saving on the physical CD, the case and the cover. It also means being able to buy only the songs that you really like.
However, many people still prefer to buy CDs. This is because they like having a whole collection. They believe that an artist's album is not simply about one song; rather, it is about the mood and story that a complete album portrays. They also enjoy owning the CD jacket, including the cover art, the lyrics and other graphics and messages that may come along with the package. Some artists also place "hidden tracks" in their CDs.
Another trend that is emerging these days is that of buying vintage records. These are the big discs of the old days. They have superior sound quality over today's CDs because they were recorded in analogue mode, not in digital format. They are also sought for their artwork. Their cover art can indeed be interesting, as they come from an era before our modern time.
One setback to collecting vintage records is that they are hard to find. Yet, this rarity only increases its appeal in the eyes of collectors and audiophiles. One good place to start is in the attics of your parents and grandparents. Another would be garage sales, where people sell old stuff at extremely low prices. Flea markets would also be a good option. You can also find such records - not at a very low price, though - in vintage record stores, though these usually can be found only in large cities.