When is it okay to confront someone?

When is it okay to confront someone who is bullying you? When do you just let it go? Where do you draw the line and say enough is enough?