I'm pretty darn shure you are going to need a new crush sleeve when dialing in the backlash. The crush sleeve is what keeps the proper tension on the pinion nut so it remains tight.

I've been through this recently...you don't want to mess with it without the right tools...and knowledge.