A former Harrods director told Sky News he does not see how security at the department store "wouldn't have known" about Mohamed al Fayed's behaviour towards women.