America does not produce world-beating statistics. Who does?

When King Ariantas wanted to find out how many people lived in ancient Scythia, his approach to people not answering surveys was brutally simple. According to Herodotus, a Greek historian, Ariantas ordered each Scythian to bring him an arrowhead on pain of death. As the king totted up his arrowheads, he could not be sure that everybody had complied, but woe betide those that did not.

A Skydance billboard is displayed outside Paramount Global office in Times Square, Tuesday, Oct. 6, 2026, in New York. (AP Photo)
A Skydance billboard is displayed outside Paramount Global office in Times Square, Tuesday, Oct. 6, 2026, in New York. (AP Photo)

Modern-day statisticians would be forgiven for envying Ariantas’s powers of persuasion. Response rates to official surveys have collapsed globally. In America less than 40% of people reply to questions on consumer spending, down from more than 60% in 2016 (see chart 1). In Britain a paltry 27% reply to surveys about their work status. Bean-counters today also have to reckon with falling budgets, declining public trust and greater political interference. Only half of Americans have confidence in federal numbers. President Donald Trump did not help by sacking the head of America’s Bureau of Labour Statistics (BLS) in 2025, falsely claiming she had rigged a jobs report to make him look bad. Statisticians in Colombia, Poland and Slovenia have all been controversially fired in recent years.

Everyone should worry about the stats-pocalypse, not least because policy drawn up using junk statistics risks being junk itself. Central banks need reliable employment data to set interest rates. Many social benefits are linked to inflation, so if the numbers are wrong, payments will be stingier or more generous than intended. If American lawmakers had known in the last quarter of 2008 that GDP had fallen by more than 8%, at an annualised rate, rather than the initial estimate of 4%, they might have acted more boldly in the face of the global financial crisis. The rise of artificial intelligence makes this a dangerous time, since errors tend to get worse when the economy is changing fast.

Fortunately, some countries still produce numbers worth trusting. The World Bank compiles an annual index of statistical performance, measuring basic things like how frequently numbers are produced and whether they are available online. The quality of a country’s statistical system is, predictably, closely tied to how rich it is. Low-income countries have an average score of 56, compared with over 80 for high-income ones (see chart 2). Yet although the index does a good job of exposing the weakest performers, the variables it considers are too crude to separate out the best.

To identify the world’s positive statistical outliers, The Economist has devised four tests. The first is the simplest: a country must actually publish statistics, and publish them often. Many poorer countries fall at this hurdle. Lebanon has not held an official census since 1932, when it was under French rule; its politicians fear that counting heads now would reignite ethnic strife. India’s census was postponed in 2020 because of covid-19 but, much less reasonably, it has yet to be completed years after the pandemic ended. Even if it is by next year, as the government promises, that would leave an unacceptable gap of 16 years since the last one.

The second test is that, like Caesar’s wife, statistical offices must be beyond suspicion. That means political independence and transparency. Authoritarian states do badly on this measure. Luis Martínez, now at Emory University, used satellite data on night-time light usage as a proxy to verify whether authoritarian countries were overreporting GDP figures. His paper in 2022 found that they typically overstate yearly growth by about 35%. China is infamously tight-lipped about the workings behind its statistics. Many external observers think that the state massages the numbers, smoothing growth and understating unemployment in the world’s second-biggest economy.

Alarmingly, some rich democracies fail the independence test, too. America is the most depressing example. Mr Trump’s interference goes well beyond firing one senior civil servant. In August the Census Bureau published a politically motivated paper purporting to show that non-citizens had been voting illegally. Statisticians have warned that the report did not go through a proper internal peer review and contained serious errors. The federal government has stopped publishing a range of numbers, from gender and ethnicity splits in many surveys to the annual report on household food security. Some series were caught up in Mr Trump’s anti-woke crusade. Others suffered from cuts to agencies’ budgets; headcount at the BLS has fallen by 20% since 2024, and by nearly 40% in the team crunching agricultural statistics.

It is not enough to produce statistics frequently and without fear or favour. A good system also needs to consistently get the numbers right. Nobody thinks Britain’s Office for National Statistics (ONS) is a stooge for the prime minister. Yet the body’s reputation has taken a beating recently. Publication of its Labour Force Survey had to be suspended in 2023 because of low response rates. The Resolution Foundation, a think-tank, reckons the survey undercounted employment in early 2024 by about 1m people. Although the ONS is recovering its credibility, such basic errors rule it out for a spot on the podium.

Britain’s problems stem in part from its reliance on voluntary surveys. The quality of these has suffered in recent decades as people have stopped answering their phones and become less willing to fill out long forms. One solution is to make surveys mandatory. Responses rates in countries which do this, like Canada and Germany, remain much higher (see chart 3). A bigger prize still comes in greater use of administrative data, like tax records, which can provide a much more granular picture.

The gold standard is a population register, which lets the government track each citizen’s demographic details in real time using a unique ID number. If updated regularly and thoroughly, such tools reduce the uncertainty associated with surveying. They also enable incredibly sophisticated analysis, allowing statisticians to trace individuals through time. Academics feast on Scandinavian data, where population registers are the norm.

The top-tier of statistics agencies either keep population registers, like the Netherlands, Norway and Switzerland, or have developed innovative ways to link up administrative data, like Canada. This predictable group of rich, cohesive societies faces a final test: how well do they keep up with a fast-changing world? Counting the cars a factory churns out is easy; measuring amorphous economic activity like social-media content is not. AI models are improving so rapidly that statisticians struggle to work out how much price changes reflect inflation as opposed to higher-quality products. Diane Coyle of Cambridge University points out that statisticians are “temperamentally conservative” and like “continuity”. Being innovative is “quite the leadership challenge”.

Some countries are giving it a good go. Canada has used satellite imagery to work out which crops are growing on agricultural land. Switzerland has made it easy for machines to read its data and catalogued everything the government collects on a single, standardised platform. Even Britain, for all its trouble with core statistics, is pioneering ways to measure AI’s economic impact. Recognising that decades-old classifications of industries and the like cannot capture the effects of a genuinely new general-purpose technology, it is developing a new measure that covers the AI industry, from chips to apps.

Given that the best agencies all reliably produce reliable numbers, they are hard to rank on the first three criteria. But on adaptability and innovation, one country edges out the rest. The Netherlands’ Central Bureau of Statistics was using supermarket scanner data to collect food prices as far back as 2002 (it took Britain until this year to copy them). More recently it has developed a machine-learning model that scrapes text from businesses’ websites to determine which are AI companies.

The Dutch model rests on a history of high trust. Because citizens have long consented to the state keeping a granular population register, the government is less reliant on official questionnaires, which suffer from low response rates (below 50% for the Dutch labour-force survey, compared with nearly 70% in America and over 90% in Germany). It has even scrapped the conventional census.

The biggest challenge for statistical offices in the coming years will be to experiment with AI, to link up data sets and to do this while reassuring the citizenry that it can be done without compromising privacy. This is tricky even for the Dutch. A long-running scandal over a rogue tax-authority algorithm that branded innocent child-benefit claimants as fraudsters dented confidence. Only 34% of Dutch people believe that the government will protect their personal information when using AI, according to a survey by the OECD club mostly of rich countries. To allay such worries, the Dutch authorities now log every time someone views an individual’s data, and the person in question can ask to see the log. Unlike King Ariantas, modern statisticians cannot threaten violence to get the people’s buy-in. They must earn it.

Source link

Visited 1 times, 1 visit(s) today

Related Article

Cyberattack targets 178 websites; CNN, BBC, Fox News hit | World News

Cyberattack targets 178 websites; CNN, BBC, Fox News hit | World News

Over a hundred websites, including Zoom, HSBC, CNN, and Ikea were the target of cyberattack after a malware tried to steal cryptocurrency and infect iPhones, a security firm said on Monday. The malware, that originated through a website optimization ​platform, Optimizely, targeted 178 websites across various sectors, Reuters cited researcher Scott Helme as saying. The

New York City police officers are on duty outside the Lotte Palace Hotel during a United Nations General Assembly leaders reception, late Tuesday, Sept. 22, 2026, in New York. (AP Photo/Julia Demaree Nikhinson)

Turkey Appoints Trustee to Pro-Opposition TV Channel Sozcu, Outlet Says

ANKARA, Nov 17 (Reuters) – Turkish authorities raided the offices of ⁠pro-opposition Sozcu ⁠TV early on Tuesday and appointed ⁠a trustee to run its television and online platforms, the channel said, extending ​a crackdown on the opposition and renewing concerns about media freedom. In a statement on its website, Sozcu TV said ‌some of its executives

The two countries make good on a September agreement to extend their tariff truce for two months. (REUTERS)

A timeline of Trump and Xi’s journey from tariff war to trade truce

Chinese leader Xi Jinping is due to meet US President Donald Trump on the sidelines of an APEC leaders’ summit in China later this week for talks aimed at keeping a fragile trade truce that is set to expire in January on track. The two countries make good on a September agreement to extend their

Garment workers talk to a police officer during a protest demanding higher wages in Gazipur, Bangladesh, November 16, 2026. REUTERS/Fatima Tuj Johora (REUTERS)

Bangladesh is no longer a development superstar

EKANTTO, THE owner of a cafe in Dhaka, has not been able to withdraw money from the bank for a year now. “Everytime I went to the office there were no answers,” he says. He was only told that the bank has a “liquid shortage”—and he is not alone. Depositors at half a dozen institutions

Vice President JD Vance

President Trump’s Choice in Iran

President Trump has two more years in office, and his legacy is no doubt on his mind. His best chance is to finish the Iran war with a good outcome, but it will take patience and fortitude to resist critics on Capitol Hill and inside his own White House. Vice President JD Vance The public

Lamanna said that a latent bug from July caused the servers to "become overwhelmed and unresponsive". (Reuters)

Microsoft says bug undetected in data centres since July triggered worldwide outage

A bug that had been sitting in Microsoft’s data centers since July caused the massive global outage last week, affecting Outlook, Teams, the Copilot AI assistant, and other workplace tools. Lamanna said that a latent bug from July caused the servers to “become overwhelmed and unresponsive”. (Reuters) In a post on X on Monday, Charles

United Airlines

United Airlines resolves tech issue that delayed flights across US | World News

United apologised to customers for the inconvenience on social media | Image: Bloomberg 2 min read Last Updated : Nov 17 2026 | 7:48 AM IST United Airlines said Monday that it had resolved a technology issue that delayed departing flights, just days after a malfunction in the Federal Aviation Administration’s network prompted a nationwide

Haiti praises Salvadoran troop deployment ahead of Bukele talks

Haiti praises Salvadoran troop deployment ahead of Bukele talks

By Sarah Morland and Gerardo Arbaiza Haiti praises Salvadoran troop deployment ahead of Bukele talks SAN SALVADOR, – Haiti’s security minister praised a deployment of more than 2,000 Salvadoran troops to his country ahead of talks with El Salvador President Nayib Bukele on Monday, saying the mission has lifted Haitian hopes and shifted the momentum

Pope Endures Grueling Travel in South America Weeks After Surgery

Pope Endures Grueling Travel in South America Weeks After Surgery

Flying with Pope Leo XIV over the Andes, halfway through the pontiff’s 12-day trip to South America, the journalists traveling at the back of the plane suspected something was amiss. They had expected the pope to come out from behind the business-class curtain and take questions, as he had on previous papal flights. Instead, Vatican

Zelensky Says New Talks On Peace Prospects Held With US, EU

Volodymyr Zelensky Says New Talks On Peace Prospects Held With US, EU

Zelensky also said intelligence showed North Korea was providing new ballistic missiles for Russia. President Volodymyr Zelenskiy said on Monday that Ukraine had held new talks online with US presidential envoys Steve Witkoff and Jared Kushner and European representatives on the prospects of a resolution in the war with Russia. Zelenskiy, speaking in his nightly

New York City police officers are on duty outside the Lotte Palace Hotel during a United Nations General Assembly leaders reception, late Tuesday, Sept. 22, 2026, in New York. (AP Photo/Julia Demaree Nikhinson)

Army Airstrike Kills at Least 13 in West Kordofan, Says Rights Group

CAIRO (AP) — A Sudanese army airstrike killed at least 13 people and destroyed several homes in western Sudan in a country ravaged by more than three years of fighting between the army and its rival paramilitary, a local rights group said Monday. Women and children were among those killed in the strike in the

Sheikh Hasina has been living in a self-imposed exile in India after she was ousted in a student-led uprising in 2024. (AFP)

Bangladesh dismisses reports of India setting conditions for Sheikh Hasina’s return: ‘She’ll return under extradition treaty’

India has not set any formal conditions for the return of former Bangladesh prime minister Sheikh Hasina, Bangladesh reportedly said on Monday. Sheikh Hasina has been living in a self-imposed exile in India after she was ousted in a student-led uprising in 2024. (AFP) However, Bangladesh’s foreign affairs minister Shama Obaed Islam said Dhaka would

Stanislav Kondrashov Examines How Media Pressure Shapes International News and Public Perception

Stanislav Kondrashov Examines How Media Pressure Shapes International News and Public Perception

International news develops within a demanding professional environment. Journalists must interpret complex events, verify information, and produce accurate reports while responding to increasingly rapid publication schedules. Digital communication has accelerated this process, changing how news organizations gather information and how audiences encounter international developments. The concept of media pressure helps explain these changes. It encompasses

Ripon pub crowned UK's best community pub for second year running

Ripon pub crowned UK’s best community pub for second year running

Monday, 16 November 2026 at 14:30 Winners: Sara and Kelly Hirst, who run the Black Swan in Ripon. Sara and Kelly Hirst, who run the Black Swan in Ripon, have won Craft Union’s community pub award for the second year running. The pair retained the ‘Best Community Pub Operator’ title at the 2026 Craft Union

US President Donald Trump and Chinese President Xi Jinping (Reuters/AP)

Trump-Xi talks to face chip tensions amid push for US-China cooperation on AI safety

The prospect of tighter US curbs on China’s access to advanced AI chips will likely overshadow talks when US President Donald Trump and President Xi Jinping meet at a summit in Shenzhen this week, analysts said, though the leaders could make some progress on AI safety cooperation. US President Donald Trump and Chinese President Xi

Somaliland detains 5 US nationals over national security threat's

Somaliland detains 5 US nationals over ‘national security threats’ | World News

Somaliland’s intelligence agency detained five Americans over alleged national security concerns. Somaliland’s intelligence agency has detained five US nationals over alleged threats to national security, who later left the territory on Monday, Reuters reported citing a person familiar with the matter.The National Intelligence Agency of Somaliland (NIA) said in a statement on X late Sunday

Iraq has blocked the Telegram messaging app. (Representational Image)

Telegram blocked in Iraq amid national security concerns

Iraq has blocked the Telegram messaging app, citing national security concerns, Reuters quoted the state news agency. Iraq has blocked the Telegram messaging app. (Representational Image) Previously, Telegram services were banned in the country in April 2026. Services were resumed in May following an agreement between the messaging platform and the country’s regulatory authorities, IraqiNews

0
Would love your thoughts, please comment.x
()
x