Rather than eliminating the some of the training data, you could add more training data to create an even balance.