Color approximation

Let's suppose we have a regular RGB image. Now we would want to approximate the color of each individual pixel of our source image with a color out of a small set of colors.

For example, all tones of red should be converted to that specific red out of my set of colors, same goes for green, blue, etc.

Is there any elegant way/algorithm to achieve this?