It was happening whenever Azumi showed up to the meeting after Shiori's accident at Azumi's second weight stage. I just tried the latest update (1.5.6) and restarted from the beginning and it seems to be working now.
Unfortunately when using old saves there can be problems. Usually a fresh start solves the issue.
