Two other children are still in critical condition after suffering burns in the fire
A 12-member official delegation, including High Commissioner in Dhaka Pankaj Saran, will accompany Modi.
National Security Adviser Ajit Doval and External Affairs Secretary S Jaishankar are the other high officials to be part of the delegation.
His accompanying entourage that will include doctors and personal staff would have 21 members.
The media team would comprise only eight members, said a foreign ministry official.
Modi will arrive at 10:15am on Saturday at Hazrat Shahjalal International Airport in a special air force flight for a two-day state visit, first after he assumed the office last year.