unfortunately as you are using vSphere4.1 you are out of look regarding DRS checking on a HA event, this is a feature of 5.x
If you do a manual vMotion then you are effectively negating your DRS affinity rules, until such a time as it physically check the rule during migration. this is as good as it gets.