Safety base...

[tadk]

Cannot find clarification on this rule anywhere.
Here is the situation:
Infield hit with a play at first, first baseman drops the thrown ball, runner runs through without touching either base. 1B picks up ball and attempts to tag runner - which base is the runner required to come back to?
In my opinion once the runner crosses the base, the safety base essentially disappears.