At least 10 people, including policemen, were injured in the attack on Kalibarhi Temple in the town around 10:30pm on Wednesday, police said.
The injured persons could not be identified immediately. They are being treated at different hospitals, sources said.
"They hurled brickbats on policemen when the law enforcers tried to bring the situation under control. Police later chased them away," he added.
Police could not confirm the motive behind the attack or the identity of the attackers as no one was arrested at the scene.
However, temple committee's general secretary Pranab Kumar told bdnews24.com: "We are fighting a case with the owners of the shops next to the temple. They might have carried out the attack."