It depends on the image type you use as a watermark.

GIFs or some species of PNG cannot be embedded to PDF “as is” and has to be converted to PDF native image format which is in fact a gzipped sequence of pixel color values. The PDF image format requires significantly more space for storing pictures (comparing to GIF, PNG etc).

Try to use JPEGs (even with high quality settings) as watermarks.