If it wanders on bumps, start with the basics.

Ball joints, tie rod ends, wheel bearings, shock absorbers. If you haven't changed them, change them. Have an alignment done.

Inspect control arm bushings, body bushings, sway bar end links and bushings, center link. Replace as necessary. Don't stiffen it up until you've made it safe.