It actually takes a while to load them. I noticed that a few days ago I set iTunes to download album art for all of my CDs... now, three days later, more than half of my CDs have album art, while others are showing up day by day.
Apple should look into this.