Tech
1970s Boy Making A Face
(Photo: D Logan / Getty Images)

The online “funhouse mirror” distorting everyone’s reality

Tiny numbers of “toxic” accounts can have massive, outsize negative effects for all.

A small, vocal minority is distorting our view of what’s normal online. That’s the conclusion of a new paper from researchers at New York University, “Inside the funhouse mirror factory: How social media distorts perceptions of norms.” 

Online discourse is… not doing well. Platforms are fighting claims of censorship in the courts, misinformation on social media is raging, and AI slop is filling up users’ feeds. 

All of this is enough to make people question just what reality looks like. It turns out that’s kind of what is happening, according to the paper, which points to several things contributing to this reality-distortion effect. 

Just 0.1% of users were responsible for 80% of fake news. 

Research cited in the paper notes that tiny numbers of “toxic” accounts can have massive, outsize negative effects for all users. “While only 3% of active accounts are toxic, they produce 33% of all content,” the authors said. Much of the false information online can be attributed to this minority group, too, noting that just 0.1% of users were responsible for 80% of fake news

This content sparks outrage among a large number of users, and can create “false polarization” among moderate users who are less likely to wade into the viper’s nest of online discussions and share their more typical viewpoints. 

Adding to the problem, online platforms are built to amplify the most extreme voices and reactions (both positive and negative) to capture our attention and distill it into engagement. 

This doesn’t just apply to social media, but also to content like online product reviews. You usually only see the worst reviews and the best reviews, and rarely anything in the middle. 

And on platforms like Meta’s Instagram, this manifests itself in a different way: you only see the perfect moments and most flattering moments from influencers (who are probably staging them). 

Even Microsoft’s LinkedIn isn't immune to this, note the authors of the paper. You’ll likely only see the most positive professional achievements in your feed, which might give you the false impression that everyone is absolutely crushing it at work except yourself. You’re less likely to see posts about more quotidian failures and setbacks. 

The paper notes that this fun house mirror doesn’t just give people a distorted view of what’s really happening, but can cause real-world harm. Citing prior research, the authors explain that these distortions can lead to teen drug and alcohol abuse, and support for authoritarian regimes

“The internet is an attention economy, but what we pay attention to is biased based towards threatening content.”

Claire E. Robertson is a research associate at NYU and the lead author of the paper. Robertson said there are two important things that platforms can do to help correct some of these distortions: be more transparent about how their algorithms work and give users more control over the content we do see.

“The internet is an attention economy, but what we pay attention to is biased based towards threatening content — things that threaten us and our social groups,” Robertson wrote in an email to Sherwood News.

This results in an amplification of negative and threatening content, Robertson said. Robertson also explained that the kind of content people actually prefer isn’t exactly a mystery. “Allowing people to make more concrete choices about the types of content they want to see might mitigate some of these negative outcomes.”

But what can people do to correct their perceptions of what’s actually happening offline in the real world? Robertson suggests a few ways that you can correct some of the biases.

“One thing you can do is compare the types of content you see online to your offline environment. Go through the last 20 people you called or texted — these are probably people you trust. How many of them have posted their opinions online? Do you think their opinions are well represented by your Twitter feed?” Robertson said.

Another exercise that Robertson suggests is to take a look at high-quality public polling on big issues from Gallup Polling or Pew Research. Robertson said there is a real disconnect between what people actually say their values are and what is portrayed online. “Most people hold nuanced views, and a notable portion hold opposite views than we would expect.”

More Tech

See all Tech
$350B

Google wants to invest even more money into Anthropic, with the search giant in talks for a new funding round that could value the AI startup at $350 billion, Business Insider reports. That’s about double its valuation from two months ago, but still shy of competitor OpenAI’s $500 billion valuation.

Citing sources familiar with the matter, Business Insider said the new deal “could also take the form of a strategic investment where Google provides additional cloud computing services to Anthropic, a convertible note, or a priced funding round early next year.”

In October, Google, which has a 14% stake in Anthropic, announced that it had inked a deal worth “tens of billions” for Anthropic to access Google’s AI compute to train and serve its Claude model.

tech

Apple to pay Google $1 billion a year for access to AI model for Siri

Apple plans to pay Google about $1 billion a year to use the search giant’s AI model for Siri, Bloomberg reports. Google’s model — at 1.2 trillion parameters — is way bigger than Apple’s current models.

The deal aims to help the iPhone maker improve its lagging AI efforts, powering a new Siri slated to come out this spring.

Apple had previously been considering using OpenAI’s ChatGPT and Anthropic’s Claude, but decided in the end to go with Google as it works toward improving its own internal models. Google, which makes a much less widely sold phone, the Pixel, has succeeded in bringing consumer AI to smartphone users where Apple has failed.

Google’s antitrust ruling in September helped safeguard the two companies’ partnerships — including the more than $20 billion Google pays Apple each year to be the default search engine on its devices — as long as they aren’t exclusive.

Apple had previously been considering using OpenAI’s ChatGPT and Anthropic’s Claude, but decided in the end to go with Google as it works toward improving its own internal models. Google, which makes a much less widely sold phone, the Pixel, has succeeded in bringing consumer AI to smartphone users where Apple has failed.

Google’s antitrust ruling in September helped safeguard the two companies’ partnerships — including the more than $20 billion Google pays Apple each year to be the default search engine on its devices — as long as they aren’t exclusive.

tech

Netflix creates new made-up metric for advertisers

It’s not quite WeWork’s community-adjusted EBITDA, but it’s also not quite a real number: Netflix announced today that it has 190 million “monthly active viewers” for its lower-cost ad-supported tiers. The company came up with the metric by measuring the number of subscribers who’ve watched “at least 1 minute of ads on Netflix per month” and multiplying that by what its research assumes is the number of people in that household.

It builds on Netflix’s previous attempt at measuring ad viewership with monthly active users, which is the number of profiles that have watched ads (94 million as of May). The MAV measurement, of course, is a lot bigger, and bigger numbers are more attractive to advertisers, who are spending more and more on streaming platforms.

“After speaking to our partners, we know that what they want most is an accurate, clear, and transparent representation of who their ads are reaching,” Netflix President of Advertising Amy Reinhard explained in a press release. “Our move to viewers means we can give a more comprehensive count of how many people are actually on the couch, enjoying our can’t-miss series, films, games, and live events with friends and family.”

Netflix last reported its long-followed and more easily understood paid membership numbers at the beginning of the year, when it crossed 300 million.

It builds on Netflix’s previous attempt at measuring ad viewership with monthly active users, which is the number of profiles that have watched ads (94 million as of May). The MAV measurement, of course, is a lot bigger, and bigger numbers are more attractive to advertisers, who are spending more and more on streaming platforms.

“After speaking to our partners, we know that what they want most is an accurate, clear, and transparent representation of who their ads are reaching,” Netflix President of Advertising Amy Reinhard explained in a press release. “Our move to viewers means we can give a more comprehensive count of how many people are actually on the couch, enjoying our can’t-miss series, films, games, and live events with friends and family.”

Netflix last reported its long-followed and more easily understood paid membership numbers at the beginning of the year, when it crossed 300 million.

tech

Ahead of Musk’s pay package vote, Tesla’s board says they can’t make him work there full time

Ahead of Tesla’s CEO compensation vote at its annual shareholder meeting tomorrow, The Wall Street Journal did a deep dive into how Elon Musk, who stands to gain $1 trillion if he stays at Tesla and hits a number of milestones, spends his time.

Like a similar piece from The New York Times in September, this one has a lot of fun details. Read it all, but here are some to tide you over:

  • Musk spent so much time at xAI this summer that he held meetings there with Tesla employees.

  • He personally oversaw the design of a sexy chatbot named Ani, who sports pigtails and skimpy clothes and for whom “employees were compelled to turn over their biometric data” to train.

  • The chatbot, which users can ask to “change into lingerie or fantasize about a romantic encounter with them,” has helped boost user numbers, which are still way lower than ChatGPT’s.

  • Executives and board members have told top investors in the past few weeks that they can’t make Musk work at Tesla full time. Board Chair Robyn Denholm explained that in his free time, Musk “likes to create companies, and they’re not necessarily Tesla companies.”

Like a similar piece from The New York Times in September, this one has a lot of fun details. Read it all, but here are some to tide you over:

  • Musk spent so much time at xAI this summer that he held meetings there with Tesla employees.

  • He personally oversaw the design of a sexy chatbot named Ani, who sports pigtails and skimpy clothes and for whom “employees were compelled to turn over their biometric data” to train.

  • The chatbot, which users can ask to “change into lingerie or fantasize about a romantic encounter with them,” has helped boost user numbers, which are still way lower than ChatGPT’s.

  • Executives and board members have told top investors in the past few weeks that they can’t make Musk work at Tesla full time. Board Chair Robyn Denholm explained that in his free time, Musk “likes to create companies, and they’re not necessarily Tesla companies.”

tech

Motion Picture Association to Meta: Stop saying Instagram teen content is “PG-13”

In October, Meta announced that its updated Instagram Teen Accounts would by default limit content to the “PG-13” rating.

The Motion Picture Association, which created the film rating standard, was not happy about Meta’s use of the rating, and sent the company a cease and desist letter, according to a report from The Wall Street Journal.

The letter from MPA’s law firm reportedly said the organization worked for decades to earn the public’s trust in the rating system, and it does not want Meta’s AI-powered content moderation failures to blow back on its work:

“Any dissatisfaction with Meta’s automated classification will inevitably cause the public to question the integrity of the MPA’s rating system.”

Meta told the WSJ that it never claimed or implied the content on Instagram Teen Accounts would be certified by the MPA.

The letter from MPA’s law firm reportedly said the organization worked for decades to earn the public’s trust in the rating system, and it does not want Meta’s AI-powered content moderation failures to blow back on its work:

“Any dissatisfaction with Meta’s automated classification will inevitably cause the public to question the integrity of the MPA’s rating system.”

Meta told the WSJ that it never claimed or implied the content on Instagram Teen Accounts would be certified by the MPA.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.