Caustics are very computationally expensive. The "damn spots" are your first approximations on how the caustics will look. It's a very rough result at first, which is why it's that grainy. Running the renderer longer (until it has figured them out at higher res) gets rid of them. For me, rendering that pic of mine took cca 1 hour.