Thanks for playing! I'm not sure what you mean. You should be able to summon the man at any time by right-clicking. I did run into a few bugs where he took a second or two to get started after clicking.
Edit: I think I know what you mean. You can left-click again to turn the sand off and summon the man before the sand runs out.