Try going visiting the other side of town. If that doesn't work, return home to end the night. More gems should spawn during the next night phase.
