This is weird but it was the problem. I recently put a TA hood on the car and when trying to get it aligned properly found that the hood was hitting the top of the booster. We changed the angle of the booster so the hood would close and found that it also made a big difference in how the brakes function. I would have never thought this would be the problem but seems like it was.