Tens of thousands of Rohingya have fled persecution in Buddhist-majority Myanmar to neighbouring Bangladesh since the early 1990s, with some of them then crossing over a porous border into Hindu-majority India.
New Delhi says only around 14,000 of the Rohingya living in India are registered with the UN refugee agency, making the rest illegal and liable to be sent back. India is not a signatory to UN conventions on refugees and no national law covers it.
"These things are being discussed at diplomatic level with both Bangladesh and Myanmar," Interior Ministry spokesman KS Dhatwalia said.
"More clarity will emerge at an appropriate time."
Rijiju was in Myanmar recently to attend an event, although it was not clear if he discussed the Rohingya issue.
Officials in Myanmar could not be contacted immediately for comment.
Amnesty International has said deporting and abandoning the Rohingya would be "unconscionable".
The Indian office of United Nations High Commissioner for Refugees said it was "trying to find the facts" about New Delhi's plans to deport them.
Rohingya are generally reviled in India, where its 1.3 billion people are fighting for resources and job opportunities. Nationalist, anti-Islamic sentiments have also fuelled hatred towards them.
A senior government official in Bangladesh, which has complained of being burdened by the heavy flow of refugees, said New Delhi was helping it solve the crisis.
The Rohingya in India live mainly in Jammu, Uttar Pradesh, Haryana and Delhi in the north, Hyderabad in the south, and Rajasthan in the west.
The Chamber of Commerce and Industry in Jammu, the winter capital of Jammu and Kashmir, India's only Muslim-majority state, drew widespread condemnation in April when it threatened to launch an "identify and kill movement" if the government did not deport Rohingya settlers there.