flask_sqlalchemy `pool_pre_ping` only working sometimes

I set the following settings:

SQLALCHEMY_ENGINE_OPTIONS = {
    'pool_size': 10,
    'pool_recycle': 60,
    'pool_pre_ping': True
}

The last few months have stopped falling…