The former Olympic swimmer and water polo player for Brazil had been in and out of the hospital in recent months with respiratory problems.
Havelange, who was 100, was the first non-European to head the International Football Federation (FIFA), world football’s governing body.
After serving 24 years as head of FIFA, Havelange resigned as its honorary president amid corruption allegations against him and others in 2013.
The Engenhao stadium in Rio de Janeiro, where many of the Rio Olympic events are currently underway, was named in his honour.