IIRC it encrypts the memory pages before writing them to the disk. That way they people cannot get a picture of the machine's memory content by just looking into the swap file.
Yes, it does have an impact but precisely at that point you are most likely IO bound so taking the time out to encrypt the block in memory is not a big thing.