Paramilitaries have been accused of burning a market and homes at a camp for displaced people.