America does not produce world-beating statistics. Who does?

When King Ariantas wanted to find out how many people lived in ancient Scythia, his approach to people not answering surveys was brutally simple. According to Herodotus, a Greek historian, Ariantas ordered each Scythian to bring him an arrowhead on pain of death. As the king totted up his arrowheads, he could not be sure that everybody had complied, but woe betide those that did not.

A Skydance billboard is displayed outside Paramount Global office in Times Square, Tuesday, Oct. 6, 2026, in New York. (AP Photo)
A Skydance billboard is displayed outside Paramount Global office in Times Square, Tuesday, Oct. 6, 2026, in New York. (AP Photo)

Modern-day statisticians would be forgiven for envying Ariantas’s powers of persuasion. Response rates to official surveys have collapsed globally. In America less than 40% of people reply to questions on consumer spending, down from more than 60% in 2016 (see chart 1). In Britain a paltry 27% reply to surveys about their work status. Bean-counters today also have to reckon with falling budgets, declining public trust and greater political interference. Only half of Americans have confidence in federal numbers. President Donald Trump did not help by sacking the head of America’s Bureau of Labour Statistics (BLS) in 2025, falsely claiming she had rigged a jobs report to make him look bad. Statisticians in Colombia, Poland and Slovenia have all been controversially fired in recent years.

Everyone should worry about the stats-pocalypse, not least because policy drawn up using junk statistics risks being junk itself. Central banks need reliable employment data to set interest rates. Many social benefits are linked to inflation, so if the numbers are wrong, payments will be stingier or more generous than intended. If American lawmakers had known in the last quarter of 2008 that GDP had fallen by more than 8%, at an annualised rate, rather than the initial estimate of 4%, they might have acted more boldly in the face of the global financial crisis. The rise of artificial intelligence makes this a dangerous time, since errors tend to get worse when the economy is changing fast.

Fortunately, some countries still produce numbers worth trusting. The World Bank compiles an annual index of statistical performance, measuring basic things like how frequently numbers are produced and whether they are available online. The quality of a country’s statistical system is, predictably, closely tied to how rich it is. Low-income countries have an average score of 56, compared with over 80 for high-income ones (see chart 2). Yet although the index does a good job of exposing the weakest performers, the variables it considers are too crude to separate out the best.

To identify the world’s positive statistical outliers, The Economist has devised four tests. The first is the simplest: a country must actually publish statistics, and publish them often. Many poorer countries fall at this hurdle. Lebanon has not held an official census since 1932, when it was under French rule; its politicians fear that counting heads now would reignite ethnic strife. India’s census was postponed in 2020 because of covid-19 but, much less reasonably, it has yet to be completed years after the pandemic ended. Even if it is by next year, as the government promises, that would leave an unacceptable gap of 16 years since the last one.

The second test is that, like Caesar’s wife, statistical offices must be beyond suspicion. That means political independence and transparency. Authoritarian states do badly on this measure. Luis Martínez, now at Emory University, used satellite data on night-time light usage as a proxy to verify whether authoritarian countries were overreporting GDP figures. His paper in 2022 found that they typically overstate yearly growth by about 35%. China is infamously tight-lipped about the workings behind its statistics. Many external observers think that the state massages the numbers, smoothing growth and understating unemployment in the world’s second-biggest economy.

Alarmingly, some rich democracies fail the independence test, too. America is the most depressing example. Mr Trump’s interference goes well beyond firing one senior civil servant. In August the Census Bureau published a politically motivated paper purporting to show that non-citizens had been voting illegally. Statisticians have warned that the report did not go through a proper internal peer review and contained serious errors. The federal government has stopped publishing a range of numbers, from gender and ethnicity splits in many surveys to the annual report on household food security. Some series were caught up in Mr Trump’s anti-woke crusade. Others suffered from cuts to agencies’ budgets; headcount at the BLS has fallen by 20% since 2024, and by nearly 40% in the team crunching agricultural statistics.

It is not enough to produce statistics frequently and without fear or favour. A good system also needs to consistently get the numbers right. Nobody thinks Britain’s Office for National Statistics (ONS) is a stooge for the prime minister. Yet the body’s reputation has taken a beating recently. Publication of its Labour Force Survey had to be suspended in 2023 because of low response rates. The Resolution Foundation, a think-tank, reckons the survey undercounted employment in early 2024 by about 1m people. Although the ONS is recovering its credibility, such basic errors rule it out for a spot on the podium.

Britain’s problems stem in part from its reliance on voluntary surveys. The quality of these has suffered in recent decades as people have stopped answering their phones and become less willing to fill out long forms. One solution is to make surveys mandatory. Responses rates in countries which do this, like Canada and Germany, remain much higher (see chart 3). A bigger prize still comes in greater use of administrative data, like tax records, which can provide a much more granular picture.

The gold standard is a population register, which lets the government track each citizen’s demographic details in real time using a unique ID number. If updated regularly and thoroughly, such tools reduce the uncertainty associated with surveying. They also enable incredibly sophisticated analysis, allowing statisticians to trace individuals through time. Academics feast on Scandinavian data, where population registers are the norm.

The top-tier of statistics agencies either keep population registers, like the Netherlands, Norway and Switzerland, or have developed innovative ways to link up administrative data, like Canada. This predictable group of rich, cohesive societies faces a final test: how well do they keep up with a fast-changing world? Counting the cars a factory churns out is easy; measuring amorphous economic activity like social-media content is not. AI models are improving so rapidly that statisticians struggle to work out how much price changes reflect inflation as opposed to higher-quality products. Diane Coyle of Cambridge University points out that statisticians are “temperamentally conservative” and like “continuity”. Being innovative is “quite the leadership challenge”.

Some countries are giving it a good go. Canada has used satellite imagery to work out which crops are growing on agricultural land. Switzerland has made it easy for machines to read its data and catalogued everything the government collects on a single, standardised platform. Even Britain, for all its trouble with core statistics, is pioneering ways to measure AI’s economic impact. Recognising that decades-old classifications of industries and the like cannot capture the effects of a genuinely new general-purpose technology, it is developing a new measure that covers the AI industry, from chips to apps.

Given that the best agencies all reliably produce reliable numbers, they are hard to rank on the first three criteria. But on adaptability and innovation, one country edges out the rest. The Netherlands’ Central Bureau of Statistics was using supermarket scanner data to collect food prices as far back as 2002 (it took Britain until this year to copy them). More recently it has developed a machine-learning model that scrapes text from businesses’ websites to determine which are AI companies.

The Dutch model rests on a history of high trust. Because citizens have long consented to the state keeping a granular population register, the government is less reliant on official questionnaires, which suffer from low response rates (below 50% for the Dutch labour-force survey, compared with nearly 70% in America and over 90% in Germany). It has even scrapped the conventional census.

The biggest challenge for statistical offices in the coming years will be to experiment with AI, to link up data sets and to do this while reassuring the citizenry that it can be done without compromising privacy. This is tricky even for the Dutch. A long-running scandal over a rogue tax-authority algorithm that branded innocent child-benefit claimants as fraudsters dented confidence. Only 34% of Dutch people believe that the government will protect their personal information when using AI, according to a survey by the OECD club mostly of rich countries. To allay such worries, the Dutch authorities now log every time someone views an individual’s data, and the person in question can ask to see the log. Unlike King Ariantas, modern statisticians cannot threaten violence to get the people’s buy-in. They must earn it.

Source link

Visited 2 times, 2 visit(s) today

Related Article

After voters’ economic rebuke, economic policy seems to have been demoted. Lame-duck presidents often pivot to foreign affairs, and Mr Trump is getting an early start. (AP)

Does Donald Trump care about the economy?

ELECTIONS, IN DEMOCRACIES, are an excellent time to complain. In America’s midterms voters made their disgust with the economy clear. Hamburgers are thought to cost too much, and nobody wants to “pick another protein”. Filling up a pickup truck for a trip to Walmart is painfully dear, and bombing the ayatollahs does little to cheer

Java is widely used by banks, hospitals, the aviation industry, government agencies, Fortune 500 companies, the corporate sector and even the military. (Unsplash/Representative Image)

US, South Korea issue urgent advisories after OpenAI Cyber model flags critical security flaws in Java

The United States and South Korea have issued urgent cybersecurity advisories after a cybersecurity firm unveiled a critical software bug in Java, a programming language widely used in key information systems, including government agencies, financial institutions and the military. Java is widely used by banks, hospitals, the aviation industry, government agencies, Fortune 500 companies, the

The Bahraini Interior Ministry did not specify the nature of the threat in its post on X. (Representational Image) (AFP)

Bahrain issues all-clear after warning of potential threat amid US-Iran exchanges

Bahrain issued an all-clear early on Wednesday, nearly an hour after warning of a potential threat and urging residents to move to the nearest safe location, as tensions escalated following exchanges of fire between the United States and Iran. The Bahraini Interior Ministry did not specify the nature of the threat in its post on

With the warning now called off, the agency suspects that an underwater landslide may have caused the distrubance (Unsplash/Representational)

New Zealand revokes tsunami warning as threat passes, disaster agency suspects ‘underwater landslide’

New Zealand’s disaster management agency cancelled a tsunami warning Wednesday after unusual activity of an unknown origin was detected off the country’s east coast. With the warning now called off, the agency suspects that an underwater landslide may have caused the distrubance (Unsplash/Representational) “Based on current science advice, the tsunami threat to the East Coast

The trilateral meeting with Presidents Xi Jinping, Donald Trump and Vladimir Putin taking place in China this week would be the first of its kind. (Wikimedia Commons/Enhanced using AI)

World News Live Updates: Trump heads to China amid US tech outages for ‘first-ever’ Xi-Putin talks, seeks to project strength | World News

The trilateral meeting with Presidents Xi Jinping, Donald Trump and Vladimir Putin taking place in China this week would be the first of its kind. (Wikimedia Commons/Enhanced using AI) US President Donald Trump is heading to China on Wednesday for talks with Chinese President Xi Jinping and Russian President Vladimir Putin, seeking to project American

Rwanda's Interior Minister Vincent Biruta, Denmark's Prime Minister Mette Frederiksen, Austria's Chancellor Christian Stocker, Austrian Interior Minister Gerhard Karner, Netherland's Foreign Minister Tom Berendsen, Denmark's Integration Minister Morten Bodskov, German Interior Minister Alexander Dobrindt and Greek Minister of Integration Athanasios Plevris pose for a family photo after migration talks in Vienna, Austria, Monday, Nov. 16, 2026. (AP)

The next stop for Europe’s failed asylum-seekers: Rwanda

“A TRULY HISTORIC paradigm shift”. “A game-changer”. “One big milestone”. If officials are cautious about overselling Europe’s new asylum deal with Rwanda, no one told the politicians from the five European governments who unveiled it in Vienna on November 16th. “This is the first real answer anyone has put on the table to solve the

FILE PHOTO/Coolthoom1, CC BY-SA 4.0, via Wikimedia Commons

Climate change is making some African deserts greener

For decades Lake Chad seemed to be a terrifying portent of climate collapse. It had been among the world’s largest lakes, on which tens of millions depended in Chad, Cameroon, Niger, and Nigeria, the four countries that share it. Yet years of punishing droughts, compounded by diversion for irrigation, between the 1960s and 1990s helped

The latest Ebola outbreak has killed thousands of people in the Democratic Republic of Congo.

A Hunger Crisis Is Making Ebola Even Deadlier

KAMPALA, Uganda—The Ebola outbreak sweeping Central and East Africa is fueling a hunger crisis that is increasing the risk of death for people who catch the virus. The latest Ebola outbreak has killed thousands of people in the Democratic Republic of Congo. The fastest-growing Ebola outbreak in history has already killed more than 5,500 people,

Jensen Huang

Jensen Huang’s Offense Wasn’t Infidelity

Jensen Huang says he’ll return to the helm of Nvidia if the board will have him, and President Trump endorses the idea. Mr. Huang says he made a “serious mistake” in his personal life, and Mr. Trump says the former CEO has learned “a big lesson.” Jensen Huang They both seem to think the mistake

Unsplash

Why startups still go public, eventually

AN AWKWARD fact about America’s stock markets is that two of the companies dictating their fortunes are not traded on them. OpenAI has raised bundles of money without bothering to list. (Doing so now would be “ill-advised”, said its boss, Sam Altman, in September.) The other leading artificial-intelligence lab, Anthropic, makes its debut on November

CCTV footage shows a Russian An-12 military aircraft crashing near Yagunovo in Siberia, killing all 19 people on board. (Unsplash Representational image)

CCTV captures Russian military plane crash in Siberia that killed all 19 onboard

CCTV footage has captured the moment a Russian military transport aircraft crashed near the village of Yagunovo in the Kemerovo region of southwestern Siberia on November 17. All 19 people aboard the aircraft died, according to Russia’s Defence Ministry. CCTV footage shows a Russian An-12 military aircraft crashing near Yagunovo in Siberia, killing all 19

The IIHF's website went offline on Tuesday following a reported cyberattack. (X @IIHFHockey)

Ice Hockey Federation website targeted in cyberattack after Russia barred from competing at World Juniors

The International Ice Hockey Federation’s website went offline on Tuesday following a reported cyberattack, which came amid controversy over its decision to exclude Russia from the world junior championship. The IIHF’s website went offline on Tuesday following a reported cyberattack. (X @IIHFHockey) According to the Canadian Press, an image featuring Russian players briefly appeared on

A military An-12 transport aircraft crashed in Russia's Kemerovo region in southwestern Siberia on Tuesday, killing all 17 people on board, Russian media outlet Izvestia reported. (Representative)

17 killed as Russian military plane crashes in Siberia

A military An-12 transport aircraft crashed in Russia’s Kemerovo region in southwestern Siberia on Tuesday, killing all 17 people on board, Russian media outlet Izvestia reported. A military An-12 transport aircraft crashed in Russia’s Kemerovo region in southwestern Siberia on Tuesday, killing all 17 people on board, Russian media outlet Izvestia reported. (Representative) The circumstances

A Serbian military jet crashed on Tuesday northwest of Belgrade, killing the pilot, the defense ministry said.

Serbian military jet crashes, killing pilot: report

A Serbian military jet crashed on Tuesday northwest of Belgrade, killing the pilot, the defense ministry said. The ministry did not immediately give a reason for the crash. The MIG-29 jet crashed around 8:45 a.m. into a field near the town of Stara Pazova, some 30 miles from the Serbian capital, a statement said. A

A poster of Taliban Supreme Leader Hibatullah Akhundzada is seen along a road in Kabul (AFP)

Taliban supreme leader makes rare visit to Afghan capital

The Taliban’s reclusive Supreme Leader Hibatullah Akhundzada made a rare visit to the Afghan capital Kabul on Tuesday, heralding the “extraordinary turn of events” that brought him to power. A poster of Taliban Supreme Leader Hibatullah Akhundzada is seen along a road in Kabul (AFP) Based in Kandahar, the southern heartland of the Taliban movement,

0
Would love your thoughts, please comment.x
()
x