Criminal charges against the 54-year-old could land him in prison - and the list of accusers is growing