Most definitely!

You must use water with either the sintered or electroplated core drills. This enables the ground debris to flush away from the area you are drilling and allows the drill to have easy up and down movement through the glass.

The water also helps keep the area you are grinding through cool so you don't stress your glass too much.