The coloring is simply a dye that is added to the phenolic resin to differentiate the grit on the pad. It actually has no usefulness on the pad at all beyond that.
If color is coming off your pad, the pad itself should still be fine. It just means we used a little too much dye in making the resin for that pad. The diamonds will still be locked into the resin and perform without any issues at all.