It only works with the toys on the floor — don't put the pictures on the wall into the box. You're supposed to place the remaining ones. Since I only made a few rooms, I didn't want to make the puzzles too simple. You're right, it might have turned out a bit hard.
