The Rohingyas deny such allegations.
The refugees accused Burmese security forces of turning a blind eye when their villages came under attack.
Sayeda Begum now has no husband and her children no father
"My husband was killed in the riots. The Burmese police were shooting only at the Muslims, not the Buddhists. The military was just watching from the rooftop and they did not intervene," said Sayeda Begum, another Rohingya Muslim woman.
Rohingya Muslims have flocked to Bangladesh over the past 30 years, bringing with them tales of oppression and exclusion.
They are denied citizenship and land rights in Burma. Human rights groups say they are among the most persecuted minorities in the world.
But Bangladesh's refusal to allow in the recent wave of refugees has also attracted criticism.
"We understand it is not that easy. So we advocate with the government of Bangladesh to give at least temporary protection status to those arriving from Rakhine state of Myanmar [Burma]," said Dirk Hebecker, a senior official from the UN Refugee Agency in the Bangladeshi town of Cox's Bazaar.
The Rohingyas who crossed into Bangladesh in the past three decades have been living in camps along the border. The unofficial refugee camps have no running water, drainage or health facilities. The Rohingyas live in abject poverty and squalor in these camps.
The recent statement by Burmese President Thein Sein that the Rohingyas should be resettled in a third country has also added to the anxiety of Rohingya refugees in Bangladesh.
"We are concerned by the president's comments. We belong to Burma and we want to go back to our villages. It is difficult to live in refugee camps like this," said Ahmed Hossain, a Rohingya community leader in Kutupalong camp, near Cox's Bazaar.
"We are willing to go back to Burma only if our security and rights are guaranteed."
For years, Bangladesh has been urging the Burmese authorities to take back the Rohingya refugees living in various camps but without much success.
The latest crisis comes at a time when Burma is gradually moving towards democracy. But many here in Bangladesh argue that the process may not be complete unless the Rohingya issue is resolved.