It seems we need to pkill all old processes from a prior upgrade and restart neutron-l3-agent services as L3HA helper processes like neutron-keepalived-state-change were still running inside the old venvs.
pkill -f neutron-keepalived-state-change; systemctl restart neutron-l3-agent.service
fixed that