I don't know if I was doing something wrong, but I kept getting stuck in places and couldn't progress. Once I entered the nearby town, I couldn't exit from it. And when I entered the castle on the north part of the town, I couldn't exit from it either.