I've had the best success with spring loaded traps using peanuts. You take a peanut half and push it in length wise into the side of the bait holder. Most of the peanut crumbles away, but you get enough wedged tightly into the bait trap to get the job done. Mice love peanuts.....and they can't just lick it off the trap like they do cheese and peanut butter.

Otherwise a Benjamin pellet gun works great.....you have to be a pretty good shot to keep from putting holes in the walls though.