Support from readers like you keeps The Journal open.
You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.
If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.
JUST LAST WEEK Fianna Fáil came out with a truly cracking howler: “Fianna Fáil is now getting more than 100 per cent less access to Prime Time than the Labour Party in the same position.”
This is poorly worded on several fronts, but as 100 per cent is the totality of something, this quote actually implies Fianna Fáil were getting minus coverage, a state of affairs that perhaps chunks of the Irish population might wish were possible.
But such faux-pas abound everywhere we look. Statistics can be a useful way to represent data, but lack of understanding and innumeracy often renders them tools of obfuscation, turning potential insight into real ignorance. In this regard, the effervescent Mark Twain’s alleged quip about the three kinds of lie, “lies, damned lies and statistics” was undoubtedly correct.
Take, for example, a HIV test. The western ink blot/ELISA test is 99.99% accurate. Your doctor, ashen faced, apologetically tells you that your test came back positive. Your heart sinks, and a myriad of questions creep up on you. But what is the probability you actually have HIV ? This might seem like a redundant question – it would seem self-evident that it’s practically certain that a positive test result means HIV is present. Yet if you’re a typical Irish person, there is just about a 50% chance that you have HIV with a positive test.
How does this make any sense ? The paradox is resolved by a little bit of extra information: the base infection rate for HIV among low-risk Irish people is 0.01%, which is about 1 in 10,000. If 10,000 low risk people walked into a clinic to get tested, you’d expect one of them to have HIV. It is practically certain this person will test positive for the disease. However, in the remaining 9,999 uninfected people, because the test does have a small margin of error, you expect it to produce one false positive. So with this reference class of low-risk people, you have two positive results, only one of which is a true positive. Hence the 50% figure.
‘If you find this surprising, you are not alone’
If you find this surprising, you are not alone. A statistic in isolation does not give the full picture. Many doctors, scientists and other experts get such odds incredibly wrong, sometimes with tragic consequences – patients sometimes get diagnosed with diseases they don’t have due to a statistical blunder. In the early days of HIV, this led to a number of suicides of patients who were actually HIV free. Even today, a surprising high figure of medical scientists make this mistake with diagnostics.
Statistical thinking is not intuitive. Yet we live in an age where we are constantly assailed by percentages, some potentially informative and some utterly dubious. Statistics can also be reported a multitude of ways, with seemingly different interpretations. Imagine the odds of getting a certain disease were two in a million or 1/500,000. Now let’s say a study finds that eating lots of red meat brings this up to three in a million. The absolute risk increase is 1/million, or 0.000001% – a minor, almost negligible risk.
Advertisement
But this is more likely to be reported as a relative risk increase. Imagine the screaming headlines – “Eating red meat makes you 50 per cent more likely to get this disease!” They both convey the same information, yet one is far more likely to shift copy. The numbers themselves do not lie – it is how they are read that causes problems.
The ambiguity of statistics also appears in finance. With just the right amount of finesse, one can make a loss appear as a profit to the unwary. A stock falling in value by 50% and then increasing by 80% seems to imply the final value of the stock would be greater by 30% than its initial amount. But this is a fallacy because these percentages refer to different things.
Using real numbers, this is easy to see: €1,000 falls by 50% to €500. This then increases by 80% to €900. The stock has fallen in value, but as the statistics subtly refer to different events, it fools us into assuming there has been an increase. This is why all too often talk of currency values, house prices and interest rates are often essentially meaningless – percentages on their own tell us practically nothing.
‘Several women were convicted on the basis of numerical ineptitude’
Yet despite this credo, many experts have the unfortunate habit of abusing statistics. Sir Roy Meadow was expert witness in a number of cot-death trials in the late 1990s . Using atrocious statistics, he convinced a jury it was almost certain these were in fact murder cases. As a result, several women were convicted on the basis of numerical ineptitude. These convictions drew the ire of the Royal Statistical society and were eventually overturned, but not before leading to the death of Sally Clark, one of the wrongly-accused women. Journalists and media outlets regularly commit jaw-dropping statistical abuse, perhaps from the urge to make something more powerful, or through yet another example of our pervasive innumeracy, or perhaps both.
So what can be done about this ? It’s important to state again statistics themselves are not the problem – our lack of understanding is. The first step should be to improve this very understanding. Darrell Huff’s How To Lie With Statistics and Gerd Gigerenzer’s Reckoning with Risk are entertaining introductions to statistics for general audiences and light on math. Wikipedia has a number of well written entries on the subject, including Misuse of Statistics.
When possible, media outlets should report figures in natural terms when statistics are likely to mislead. This would massively reduce confusion as it is a much more intuitive way of stating changes in risks and values. If it is 20 degrees Tuesday, everyone understands a fall of four degrees the next day means 16 degrees on Wednesday. Writing this as a fall of 20% is not nearly as clear. Tuesday was four degrees higher than Wednesday, or 25% higher. The natural frequencies remain consistent with a difference of 4 degrees each way, but the statistical difference changes both ways. For this reason, natural statements of finance, risk and value should be preferred over statistical statements when possible.
The crux of the issue is we must learn to understand statistics. Numeracy can be improved, and it is essential that we, as a society, do so. HG Wells once said “Statistical thinking will one day be as necessary for efficient citizenship as the ability to read and write.” That day is now. Until we understand statistics and data as more than just some arcane numbers or soundbite, we will continue to fall victim to misinformation.
David Robert Grimes is a doctor of medical physics with a keen interest in the public understanding of science. He writes a blog on science and medicine called Three Men Make A Tiger.
Readers like you are keeping these stories free for everyone...
A mix of advertising and supporting contributions helps keep paywalls away from valuable information like this article.
Over 5,000 readers like you have already stepped up and support us with a monthly payment or a once-off donation.
Famine 'now unfolding' in Gaza 'unlike anything seen in this century', says UN's WFP
1 hr ago
2.6k
Courts
Former garda who impersonated colleague online to encourage men to rape her jailed for seven years
43 mins ago
7.7k
Maguiresbridge
Suspect in shooting of mother and children in Co Fermanagh dies in hospital
15 hrs ago
84.0k
Your Cookies. Your Choice.
Cookies help provide our news service while also enabling the advertising needed to fund this work.
We categorise cookies as Necessary, Performance (used to analyse the site performance) and Targeting (used to target advertising which helps us keep this service free).
We and our 214 partners store and access personal data, like browsing data or unique identifiers, on your device. Selecting Accept All enables tracking technologies to support the purposes shown under we and our partners process data to provide. If trackers are disabled, some content and ads you see may not be as relevant to you. You can resurface this menu to change your choices or withdraw consent at any time by clicking the Cookie Preferences link on the bottom of the webpage . Your choices will have effect within our Website. For more details, refer to our Privacy Policy.
We and our vendors process data for the following purposes:
Use precise geolocation data. Actively scan device characteristics for identification. Store and/or access information on a device. Personalised advertising and content, advertising and content measurement, audience research and services development.
Cookies Preference Centre
We process your data to deliver content or advertisements and measure the delivery of such content or advertisements to extract insights about our website. We share this information with our partners on the basis of consent. You may exercise your right to consent, based on a specific purpose below or at a partner level in the link under each purpose. Some vendors may process your data based on their legitimate interests, which does not require your consent. You cannot object to tracking technologies placed to ensure security, prevent fraud, fix errors, or deliver and present advertising and content, and precise geolocation data and active scanning of device characteristics for identification may be used to support this purpose. This exception does not apply to targeted advertising. These choices will be signaled to our vendors participating in the Transparency and Consent Framework. The choices you make regarding the purposes and vendors listed in this notice are saved and stored locally on your device for a maximum duration of 1 year.
Manage Consent Preferences
Necessary Cookies
Always Active
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.
Social Media Cookies
These cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.
Targeting Cookies
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.
Functional Cookies
These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then these services may not function properly.
Performance Cookies
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous. If you do not allow these cookies we will not be able to monitor our performance.
Store and/or access information on a device 149 partners can use this purpose
Cookies, device or similar online identifiers (e.g. login-based identifiers, randomly assigned identifiers, network based identifiers) together with other information (e.g. browser type and information, language, screen size, supported technologies etc.) can be stored or read on your device to recognise it each time it connects to an app or to a website, for one or several of the purposes presented here.
Personalised advertising and content, advertising and content measurement, audience research and services development 195 partners can use this purpose
Use limited data to select advertising 158 partners can use this purpose
Advertising presented to you on this service can be based on limited data, such as the website or app you are using, your non-precise location, your device type or which content you are (or have been) interacting with (for example, to limit the number of times an ad is presented to you).
Create profiles for personalised advertising 119 partners can use this purpose
Information about your activity on this service (such as forms you submit, content you look at) can be stored and combined with other information about you (for example, information from your previous activity on this service and other websites or apps) or similar users. This is then used to build or improve a profile about you (that might include possible interests and personal aspects). Your profile can be used (also later) to present advertising that appears more relevant based on your possible interests by this and other entities.
Use profiles to select personalised advertising 120 partners can use this purpose
Advertising presented to you on this service can be based on your advertising profiles, which can reflect your activity on this service or other websites or apps (like the forms you submit, content you look at), possible interests and personal aspects.
Create profiles to personalise content 51 partners can use this purpose
Information about your activity on this service (for instance, forms you submit, non-advertising content you look at) can be stored and combined with other information about you (such as your previous activity on this service or other websites or apps) or similar users. This is then used to build or improve a profile about you (which might for example include possible interests and personal aspects). Your profile can be used (also later) to present content that appears more relevant based on your possible interests, such as by adapting the order in which content is shown to you, so that it is even easier for you to find content that matches your interests.
Use profiles to select personalised content 48 partners can use this purpose
Content presented to you on this service can be based on your content personalisation profiles, which can reflect your activity on this or other services (for instance, the forms you submit, content you look at), possible interests and personal aspects. This can for example be used to adapt the order in which content is shown to you, so that it is even easier for you to find (non-advertising) content that matches your interests.
Measure advertising performance 177 partners can use this purpose
Information regarding which advertising is presented to you and how you interact with it can be used to determine how well an advert has worked for you or other users and whether the goals of the advertising were reached. For instance, whether you saw an ad, whether you clicked on it, whether it led you to buy a product or visit a website, etc. This is very helpful to understand the relevance of advertising campaigns.
Measure content performance 78 partners can use this purpose
Information regarding which content is presented to you and how you interact with it can be used to determine whether the (non-advertising) content e.g. reached its intended audience and matched your interests. For instance, whether you read an article, watch a video, listen to a podcast or look at a product description, how long you spent on this service and the web pages you visit etc. This is very helpful to understand the relevance of (non-advertising) content that is shown to you.
Understand audiences through statistics or combinations of data from different sources 111 partners can use this purpose
Reports can be generated based on the combination of data sets (like user profiles, statistics, market research, analytics data) regarding your interactions and those of other users with advertising or (non-advertising) content to identify common characteristics (for instance, to determine which target audiences are more receptive to an ad campaign or to certain contents).
Develop and improve services 116 partners can use this purpose
Information about your activity on this service, such as your interaction with ads or content, can be very helpful to improve products and services and to build new products and services based on user interactions, the type of audience, etc. This specific purpose does not include the development or improvement of user profiles and identifiers.
Use limited data to select content 51 partners can use this purpose
Content presented to you on this service can be based on limited data, such as the website or app you are using, your non-precise location, your device type, or which content you are (or have been) interacting with (for example, to limit the number of times a video or an article is presented to you).
Use precise geolocation data 65 partners can use this special feature
With your acceptance, your precise location (within a radius of less than 500 metres) may be used in support of the purposes explained in this notice.
Actively scan device characteristics for identification 36 partners can use this special feature
With your acceptance, certain characteristics specific to your device might be requested and used to distinguish it from other devices (such as the installed fonts or plugins, the resolution of your screen) in support of the purposes explained in this notice.
Ensure security, prevent and detect fraud, and fix errors 122 partners can use this special purpose
Always Active
Your data can be used to monitor for and prevent unusual and possibly fraudulent activity (for example, regarding advertising, ad clicks by bots), and ensure systems and processes work properly and securely. It can also be used to correct any problems you, the publisher or the advertiser may encounter in the delivery of content and ads and in your interaction with them.
Deliver and present advertising and content 126 partners can use this special purpose
Always Active
Certain information (like an IP address or device capabilities) is used to ensure the technical compatibility of the content or advertising, and to facilitate the transmission of the content or ad to your device.
Match and combine data from other data sources 94 partners can use this feature
Always Active
Information about your activity on this service may be matched and combined with other information relating to you and originating from various sources (for instance your activity on a separate online service, your use of a loyalty card in-store, or your answers to a survey), in support of the purposes explained in this notice.
Link different devices 67 partners can use this feature
Always Active
In support of the purposes explained in this notice, your device might be considered as likely linked to other devices that belong to you or your household (for instance because you are logged in to the same service on both your phone and your computer, or because you may use the same Internet connection on both devices).
Identify devices based on information transmitted automatically 116 partners can use this feature
Always Active
Your device might be distinguished from other devices based on information it automatically sends when accessing the Internet (for instance, the IP address of your Internet connection or the type of browser you are using) in support of the purposes exposed in this notice.
Save and communicate privacy choices 103 partners can use this special purpose
Always Active
The choices you make regarding the purposes and entities listed in this notice are saved and made available to those entities in the form of digital signals (such as a string of characters). This is necessary in order to enable both this service and those entities to respect such choices.
have your say