SecurityBrief New Zealand - Technology news for CISOs & cybersecurity decision-makers
Story image

Twitter bots create a third of the world's misinformation

Wed, 21st Nov 2018
FYI, this story is more than a year old

Lies, fake news and misinformation – this is the age of the internet, and Twitter bots are largely responsible for perpetrating it.

That's according to a study from the US University of Indiana, which dug deep into the 2016 US presidential campaign. Researchers analysed 14 million messages and 400,000 articles shared on Twitter between March 2016 and May 2017.

They found that automated bots spread one third of articles with the lowest credibility scores. They also found that bots also target ‘influential' users who are heavily active on Twitter.

Why? They think it's because people are vulnerable to manipulation and share some of the content originating from bots.

New Zealand's Science Media Centre quizzed two local New Zealand experts from the University of Auckland on what they thought about the study. Here's what they had to say.

University of Auckland Business School Department of Information Systems and Operations Management, associate professor Lech Janczewski

"The use of social bots in spreading false information is based on a mechanism identical to that used in Distributed Denial of Service (DDoS) cyber-attacks,” says Janczewski.

"A DDoS attack is based on creation of bots - networks of devices connected to the internet and infected with special attacking software controlled by an attacker. Almost anyone can buy or find tools online to create bots that act across thousands of terminals, with the power to spread false information to millions. Infection is possible if a device does not have the capabilities to detect malware in the received message.

"Bots exploit the fact that there is no built-in way to verify who is sending information over the internet. The TCP/IP telecommunications protocol – an international set of rules for data transmission - cannot verify senders' identity unless extra security apps have been installed on the receiver.

"As the first step to protect yourself from bots, switch your device to 'secure mode' (seen on your browser by conversion of 'http' to 'https'). That is only possible if the transmitter is ready to use the https mode. However, a skilled attacker may override that as well,” Janczewski adds.

"Significant numbers of bot messages are recognised by SPAM filters but not all of them. Spotting a message coming from a bot can sometimes be tricky.

"Basically, it is up to the user to accept a message after answering ‘yes' to these two questions:

1. Do I have a proof that the message came from the source it is claiming? 2. Is the transmitter known as a source of reputable information?"

University of Auckland Business School Information Systems and Operation Management associate professor Arvind Tripathi

"This study finds that social bots (automated fake accounts on social media platforms) play a disproportionate role in spreading misinformation or fake news.

"We already knew that bots play a role in spreading fake news. However, this study quantifies their disproportionate role and identifies the mechanism they employ in spreading false information,” says Tripathi. "This study has analysed 14 million messages to confirm their findings.

Disproportionate roles:  "Authors found that only 6 per cent of social media accounts, tagged as bots, were responsible for spreading 31 per cent of all tweets linking to fake news (low-credibility articles) and 34 per cent of all fake news (low-credibility articles).

Spreading mechanism:

"Spreading patterns of fake news are less conversational, these are mostly spread via original tweets or retweets by bots, not via replies or comments.

"As fake news spreads, more tweets are concentrated in the hands of few accounts which is opposite to the organic way of spreading the factual information. When information spreads in an organic way, the contribution of any individual account or group of accounts should matter less.

"Social bots post content, interact with each other, and with legitimate users just like real people and so it is easy to get duped on social media platforms believing in fake news,” Tripathi says.

"Social bots are deployed to promote fake content which comes from low-credibility sources that mimic news media outlets.


"If you are looking at a news or article (link) that is published on a news source that you have never heard of, you should be concerned. There are many fact checking sites that list these dodgy sources but new ones can be created as quickly as old ones are identified.

"The safe approach is to only rely on well-known news media channels such as CNN, New York Times, BBC or known local media sources. For example, if news is only promoted by an obscure source, one should be concerned. One can easily click on that account to see if this account is only promoting these articles or is engaged in other conversations as well."

Follow us on: