Futurity

What are the dangers of facial recognition tech?

A researcher explains the risks around facial recognition tech. "The privacy risks we uncover in our research should make anyone uncomfortable."
A teenage boy in a black jacket stands in front of a yellow wall with a black and white target on it. His head is in the center of the target.

With facial recognition becoming more widespread, Michal Kosinski has concerns about the dangers of the technology and the controversies that come with it.

Kosinski’s research makes people uncomfortable. “As it should,” he says. “The privacy risks we uncover in our research should make anyone uncomfortable.”

In his most recent study, published earlier this year in Scientific Reports, Kosinski fed more than 1 million social media profile photos into a widely used facial recognition algorithm and found that it could correctly predict a person’s self-identified political ideology 72% of the time. In contrast, humans got it right 55% of the time.

Kosinski, an associate professor of organizational behavior at the Stanford University Graduate School of Business, does not see this as a breakthrough but rather a wake-up call. He hopes that his findings will alert people (and policymakers) to the misuse of this rapidly emerging technology.

Kosinski’s latest work builds on his 2018 paper in which he found that one of the most popular facial recognition algorithms, likely without its developers’ knowledge, could sort people based on their stated sexual orientation with startling accuracy.

“We were surprised—and scared—by the results,” he recalls. When they reran the experiment with different faces, “the results held up.”

That study sparked a firestorm. Kosinski’s critics says he was engaging in “AI phrenology” and enabling digital discrimination. He responded that his detractors were shooting the messenger for publicizing the invasive and nefarious uses of a technology that is already widespread but whose threats to privacy are still relatively poorly understood.

He admits that his approach presents a paradox: “Many people have not yet realized that this technology has a dangerous potential. By running studies of this kind and trying to quantify the dangerous potential of those technologies, I am, of course, informing the general public, journalists, politicians, and dictators that, ‘Hey, this off-the-shelf technology has these dangerous properties.’ And I fully recognize this challenge.”

Kosinski stresses that he does not develop any artificial intelligence tools; he’s a psychologist who wants to better understand existing technologies and their potential to be used for good or ill.

“Our lives are increasingly touched by the algorithms,” he says. Companies and governments are collecting our personal data wherever they can find it—and that includes the personal photos we publish online.

Here, Kosinski explains the controversies surrounding his work and the implications of its findings:

The post What are the dangers of facial recognition tech? appeared first on Futurity.

More from Futurity

Futurity3 min read
Giving NICU Babies Tylenol After Surgery Improves Outcomes
In a new study, giving babies in the NICU acetaminophen instead of opioids following surgery correlated with fewer unplanned intubations and improved mortality rates. The study, published in the Journal of Pediatric Surgery, streamlined care followin
Futurity3 min read
Nursing Home Location May Shape ‘Chemical Restraint’ Overuse
Nursing homes in disadvantaged communities are more likely to overmedicate residents with antipsychotics, especially homes that are understaffed, according to a new study. “The neighborhood in which a nursing home is located seems to influence how wi
Futurity3 min read
How Can Physics Become More Diverse?
A new paper explores the problems with physics culture and provides a road map for making departments in the field more equitable. Physics has long suffered from the perception that the most cutting-edge work is done by lone geniuses, usually white m

Related Books & Audiobooks