A CMS is a piece of software that produces a website - you install it on your webserver then just plug in the pictures and words and it builds the code.
They use 'themes' to determine how the pages look, which you can edit, Once set up with a theme, you can add/edit/remove content (text, images...