I scanned a pic of a fuel pump out of a manual I have. You can see the inlet and outlet check valves that only allow fuel to flow one way. If the rubber on these valves is not good you could have some seepage back. The pump will continue to work fine although won't be as efficient per stroke.

Easy to fix with a new fuel pump if this is in fact the problem.