External review finds deeper rot in World Bank 'Doing Business' rankings

Weeks before the World Bank scrapped its flagship Doing Business rankings following a damning independent probe, a group of external advisers recommended an overhaul of the rankings to limit countries' efforts to "manipulate their scores."

An 84-page review, written by senior academics and economists, including the former Colombian finance minister, was published on the bank's website on Monday, about three weeks after it was submitted to World Bank chief economist Carmen Reinhart.

The World Bank on Thursday said it would cancel the "Doing Business" series on country business climates, citing internal audits and an independent probe that found senior World Bank leaders, including Kristalina Georgieva, who now heads the International Monetary Fund, pressured staff to alter data to favour China during her time as World Bank CEO.

Georgieva has strongly denied the findings.

The review published on Monday was written by a group assembled by the World Bank in December 2020, after a series of internal audits revealed data irregularities in reports on China, Saudi Arabia, the United Arab Emirates and Azerbaijan.

It calls for a series of remedial actions and reforms to address the "methodological integrity" of the Doing Business report, citing what it called "a pattern of government efforts to interfere" with scoring for the reports in past years.

The experts faulted the Doing Business series for lack of transparency about the underlying data and questionnaires used to calculate the rankings, called for a firewall between the Doing Business team and other World Bank operations, and creation of a permanent, external review board.

"We have been informed of multiple cases where national governments have attempted to manipulate the DB scores by exerting pressure on individual contributors," the report said, pointing to lawyers, accountants, or other professionals.

"World Bank staff mentioned several countries where they believe government officials have instructed contributors how to respond. And even in the absence of explicit government pressure, of course, the perceived threat of retaliation may influence the scores contributors report."

The authors also called for the bank to stop selling consulting services to governments aimed at improving a country's score, noting that they constituted an apparent conflict of interest.

"The World Bank should not simultaneously engage in scoring countries’ business environment while accepting payment to coach countries on how to improve their scores," the authors wrote. The World Bank offered these "Reimbursible Advisory Services," or RAS in a number of countries, including some of those implicated in the data manipulation investigation, such as China and Saudi Arabia, the review said.

In December 2020, the review said, one internal audit reported that bank management had pressured nine of 15 staff to manipulate data in the 2018 and 2020 issues of the Doing Business index, boosting Saudi Arabia to the "most reformed" spot globally and buoying the rankings of the United Arab Emirates and China, while dropping Azerbaijan from the top 10 rankings, the external advisers reported.