Tuesday, January 28, 2025, 8:41PM |  41°
MENU
Advertisement
Dina Hussein, global head of policy development and expert partnerships for counterterrorism and dangerous orgs policy for Meta, speaks during the Eradicate Hate Global Summit 2023 at the David L. Lawrence Convention Center in Downtown on Tuesday, Sept. 27, 2023.
1
MORE

TikTok, Meta address online hate at Pittsburgh summit

Lucy Schaly/Post-Gazette

TikTok, Meta address online hate at Pittsburgh summit

As TikTok and Meta race to flag and remove hateful comments swirling through their platforms, generative artificial intelligence is making it even harder to keep up.

"It's an everlasting game of chasing," Yfat Barak-Cheney, director of technology and human rights for the World Jewish Congress, said Wednesday at the Eradicate Hate Global Summit in Pittsburgh.

But nonprofits using AI for good may be able to help.

Advertisement

In its first three months partnering with TikTok, CyberWell, an Israeli tech nonprofit backed by the Shear Family Foundation of Pittsburgh, alerted the short-form video company to three major antisemitic trends.

Ryan Scrivens, an assistant professor at Michigan State University, speaks at a session on violent extremists at the 2023 Eradicate Hate Summit at the David L. Lawrence Convention Center.Thursday Sept. 28, 2023, (Pittsburgh Post-Gazette)
Anya Sostek
‘This is where we need to start’: High school students gather for Eradicate Hate Student Summit

The most heinous conspiracy theory claimed that Jews were killing babies for ritual sacrifice and selling the bodies to McDonald's for hamburger meat.

"Before you lose hope, or your lunch, we'll go into the wonderful successes of actually working together with TikTok," Tal-Or Cohen Montemayor, CyberWell's founder and executive director, told an audience of about 200 at the summit.

Ms. Montemayor said the 2018 massacre at Pittsburgh's Tree of Life Synagogue convinced her to leave her career in law to focus on hate research. By making that research open source, CyberWell's data could eventually be used to train generative artificial intelligence models that are quickly becoming part of social media platforms, Ms. Montemayor said.

Advertisement

She noted that one social media company, X, was not part of the panel that included policy officials from TikTok, Microsoft and Meta.

Formerly known as Twitter, X saw a steep drop-off in content moderation after it was purchased by billionaire Elon Musk in October 2022.

"It's very concerning," Ms. Montemayor said of the absence. "Actually, these platforms are the ones we need to be focused on."

Still, others at the summit noted that extremists are continuing to reach large audiences on TikTok and other mainstream platforms despite efforts to remove harmful content.

Pittsburgh Synagogue Shooting Trial:  Claiming Our Voices in the Judicial Process, was the title of this session during the Eradicate Hate Global Summit 2023 at the David L. Lawrence Convention Center on Tuesday, Sept. 27, 2023. These individuals were all involved in the Tree of Life tragedy in Squirrel Hill.  Pictured, left to right are moderator Maggie Feinstein, director of 10.27 Healing Partnership, Amy Mallinger, Audrey Glickman, Jodi Kart, Michele Rosenthal, and SWAT Officer Jonathan Craig. (Lucy Schaly/Post-Gazette)
Megan Guza
Pittsburgh synagogue shooting families talk about how their lives have changed since the 2018 massacre

During two weeks in July, the Institute for Strategic Dialogue charted over 1 million TikTok views of 20 ISIS accounts.

The Institute, a U.K.-based nonprofit, also found a 106% increase in antisemitism and a 69% increase in accounts following known misogynist and abusive accounts on Twitter after Musk took over the platform.

More concerning, some platforms were actively recommending harmful content to users through hashtags and other promotion.

TikTok removes 90% of harmful content proactively, with 75% of problem videos taken down before they get a single view, Valiant Richey, TikTok's global head of outreach and partnerships for trust and safety, said at the summit.

He highlighted a promotional video viewed more than 250 million times that encouraged users to adjust their settings and report hateful content, saying "we want to empower users."

But reporting individual pieces of content is often a frustrating and insufficient process, said Ms. Barak-Cheney of the World Jewish Congress. Instead of focusing on reporting, companies should target the offline issues that lead people to radicalization, she said.

"Hate is a process," she said.

Meta has banned holocaust denial since 2020, although its implementation of that policy has been more spotty.

On Wednesday, Dina Hussein, the company's global head of policy development and expert partnerships for counterterrorism and dangerous orgs policy, said it's great to build a policy but "very difficult if you can't deploy it.”

She said some new technologies have helped speed up flagging efforts. That includes working with tracking partners, identifying "clusters of abusive networks" and trying to prevent recidivism from specific actors.

Ms. Hussein did not specifically list generative AI, but she did talk about how quickly technology is changing.

"While we're advising our tactics, the adversary is also mutating," Ms. Hussein said.

One way Meta and TikTok have tried to tamp down on holocaust denial is by redirecting users to educational sites.

By pointing users toward authoritative partners who might be more influential, Meta can avoid coming across like "your parents telling you not to do drugs," Ms. Hussein said.

Ms. Barak-Cheney called the redirect "a way to catch people at an early stage."

Smaller platforms, whose trust and safety teams tend to focus most of their time on spam, should also be incentivized to take on that work, she said.

Content review teams, which are often under-resourced, could augment their work with AI so that the humans are free to spend more of their time on the most impactful cases, said Michael Pappas, CEO and co-founder of Modulate, a Boston startup using AI to curb toxic conversation among gamers.

But the new tools aren't a panacea.

"Please don't just trust an AI to moderate your content," he told the panel. "It's not the right way to use this technology."

Microsoft was the most optimistic of the three major tech companies on the use of AI.

"It's difficult to think of a problem or a challenge that we face as a society that AI can't contribute to resolving," said Hugh Handeyside, senior policy manager of Microsoft's digital safety office.

"There's just untold potential."

The company is currently rolling out a content safety system as part of its OpenAI Service for Azure enterprise customers, Mr. Handeyside said. The service added ChatGPT capability in March.

Eventually, Mr. Handeyside said, AI could help the company "mitigate risk … in a global and nuanced way."

Evan Robinson-Johnson: ejohnson@post-gazette.com 

First Published: September 27, 2023, 11:01 p.m.
Updated: September 28, 2023, 2:23 a.m.

RELATED
Mark Nordenberg, co-chair of the Eradicate Hate Global Summit and chancellor emeritus and chair of the Institute of Politics at the University of Pittsburgh, welcomes participants to the Eradicate Hate Global Summit at the David L. Lawrence Convention Center in Downtown Pittsburgh on Monday, Oct. 18, 2021.
Megan Tomasic
'Shape the world': Western Pennsylvania students to participate in Eradicate Hate Summit
SHOW COMMENTS (4)  
Join the Conversation
Commenting policy | How to Report Abuse
If you would like your comment to be considered for a published letter to the editor, please send it to letters@post-gazette.com. Letters must be under 250 words and may be edited for length and clarity.
Partners
Advertisement
Pittsburgh Steelers owner Arthur J. Rooney II looks on prior to the NFL football game against the Philadelphia Eagles, Sunday, Dec. 15, 2024, in Philadelphia.
1
sports
Jason Mackey: Art Rooney II's reasoning for keeping Mike Tomlin as Steelers coach feels misguided
Kansas City Royals' Adam Frazier waits to take batting practice before a baseball game against the Houston Astros, Friday, Aug. 30, 2024, in Houston.
2
sports
Adam Frazier returns to Pirates on 1-year, major league deal
Tensions in Charleroi, PA, intensified after President-elect Donald Trump and Senator JD Vance made controversial remarks about the town's Haitian community, alleging that they were financially draining local resources.
3
news
Fear and anxiety ripple through Western Pa. communities amid immigration crackdown
Van Jefferson #11 of the Pittsburgh Steelers celebrates with Calvin Austin III #19 after making a catch for a touchdown against the Baltimore Ravens during the second half of the AFC Wild Card Playoff game at M&T Bank Stadium on January 11, 2025 in Baltimore, Maryland.
4
sports
Ray Fittipaldo's Steelers chat transcript: 01.28.25
Pittsburgh Steelers quarterback Justin Fields is greeted by Pittsburgh Steelers quarterback Russell Wilson after scoring a touchdown against the Los Angeles Chargers at the Acrisure Stadium on Sunday, Sept. 22, 2024, in the North Shore. The Pittsburgh Steelers won 20-10.
5
sports
Gerry Dulac: Steelers want a streamlined QB style, so who fits the bill?
Dina Hussein, global head of policy development and expert partnerships for counterterrorism and dangerous orgs policy for Meta, speaks during the Eradicate Hate Global Summit 2023 at the David L. Lawrence Convention Center in Downtown on Tuesday, Sept. 27, 2023.  (Lucy Schaly/Post-Gazette)
Lucy Schaly/Post-Gazette
Advertisement
LATEST business
Advertisement
TOP
Email a Story