This was a lot of work! First I converted the photo to black and white. Then I added a separate adjustment layer with a color Blend Mode for each color that I hand painted back in.

The result should look like the hand tinted black and white photos of years gone by.