..what I mean by bypassing is that either the solenoid is still allowing power to go through... or... your ignition switch is stuck on the "start" section allowing the circuit to complete to allow power to travel to the starter.
wiring circuit... battery, ignition, solenoid, starter. Its not battery, and starter should only engage when power is applice, so it should be one of the other two..