indirect kick and no time to recover

[golfdesigner]

situation from last saturday in youth soccer game, goalie retrieved ball, while running, getting ready to kick, inadvertantly hit ball with knee and fumbled it, then goalie picked it up and kicked it forward...ref called "indirect kick" and gave goalie no time to recover and get back in goal..poor goalie didn't have a chance to get back...

Should ref have given goalie at least a little time to recover and get back in position or was he just out of luck and needed to get back real fast?