Please take a picture of what you are describing. It sounds to me like nothing may be wrong other that it needs some adjustment. Jeff is correct though, don't ever apply the brakes with the drum off, nothing good can happen. Also I would not get to hung up on one moving and the other not with no drum in place. During real braking, a 1000+ pounds are acting on both sides. They will move unless something is really messed up..