The workers were constructing a toilet at a school next to the temple in Faridpur’s Madhukhali Upazila
Md Moslem Pradhan, 68, was detained from Nikli Upazila on Monday night on charges of crimes against humanity, which includes killing of 25 during the war in 1971.
Bangladesh is trying suspected war criminals from 2010, after the Awami League came to power in 2009.
Kishoreganj police sent him to Dhaka on Tuesday afternoon for trial at the International Crimes Tribunal.
Habib Reza, chief of a local organisation against the war criminal, said Pradhan allegedly forced Hindus to convert to Islam, and torched and looted their houses at Damparha during the war.