After failover, I'm seeing the following in the logs:
failover session lock ({session ID}) not removed because primary has not reported as healthy'
This means the FAILOVER_IN_PROGRESS key isn't getting removed. The primary is marked as healthy however, so this error may be the result of some improper exception handling that's masking some other issue.