They turn red when they are ripe, so if you want the best flavor and heat (Anaheims don't have much heat to begin with), wait until they are bright red. If you want to harvest them green, make sure they are as big as they are going to get, then pick and roast them and peel the skin off before consuming. I think the skin causes a lot of the bitterness, and it is tough to chew through.