My factory mirror works fine, so I don't have to deal with it. I was hoping to see if I could pick up something on this one, but it seems that no one has a viable solution. Maybe a knot in the cable, but it it worked, you would have to secure it so it didn't slip with anything from goose tape to silicone.
As a last ditch, I might consider slightly kinking one of the cables to create a bind on the internal wire. As for the wear factor, once you have it set, and it doesn't travel, you shouldn't have to set it again. Once I set my remote on the last build in 87, I never set it again untill this last time I had the panel off.