He played a key role in the 1971 Bangladesh Liberation War.
He died in the Army Hospital (Research and Referral) in New Delhi on Saturday, an official statement said.
General Rao was commissioned in August 1942 and saw action as a Company Commander of 3 Mahar in Kashmir operations of 1948.
He later on commanded the same battalion.
His moment of glory though came as the GOC of 8 Mountain Division in Bangladesh’s Sylhet sector in the 1971 War.
He is also visible in the most famous photograph of the 1971 War, in which Pakistani Lt General Niazi surrendered to Lt General J S Arora.
He was appointed as the 14th Chief of Army Staff on June 1, 1981 and served in that capacity till July 1983.
From June 1984 to July 1989, General Krishna Rao was the Governor of the North Eastern States of Nagaland, Manipur and Tripura.
He was also the Governor of Mizoram in June 1988 and March to July 1989.
Later, when a proxy war developed in Jammu and Kashmir and reached its peak, he was reappointed as Governor and served there from March 1993 to May 1998.
President Pranab Mukherjee, Defence Minister Manohar Parrikar, the Indian Army chief, General Dalbir Singh and Tripura Governor Tathagatha Roy, among others, condoled Gen. Krishna Rao's death.
In a message to his son, K V L Narayan Rao, the President said, “I am sad to learn about the passing away of your father, General K V Krishna Rao, former Chief of Army Staff. General Rao was a distinguished public servant who made his mark as Chief of the Army Staff. For his outstanding services to the Indian Army, he was honoured with the Param Vishisht Seva Medal.”
“His exemplary services to the nation and the Indian Army shall always be remembered. Please accept my heartfelt condolences and convey them to the rest of your family members. I pray to the Almighty to give you and other members of your family, the strength and courage to bear this irreparable loss,” President Mukherjee said in his message.
Parrikar remembered the veteran's contribution in the 1971 war.
"The country has lost one of our best known military leaders. He was a visionary who led ably, inspired a generation of soldiers and initiated modernisation of the Indian Army in the early 1980s. His contribution in the 1971 war and maintaining the unity and integrity of the country shall always be remembered," the defence minister said.
In his message, Roy said "I just came to know about the passing away of K V Krishna Rao. I am deeply saddened to hear of his death. He was a very successful Governor and my predecessor.”
