AI-driven ‘intention economy’ might manipulate user decisions

Researchers from the University of Cambridge warn that artificial intelligence might give rise to an “intention economy.” 

Their recent study argues that AI agents will have access to vast amounts of psychological and behavioral data. 

READ: AI’s real impact on the global economy

This information could enable bots to build trust and understanding with users, allowing social manipulation “on an industrial scale.” 

Intention economy will put your opinions on sale

Cambridge’s Leverhulme Center for the Future of Intelligence (LCFI) says that people worldwide are becoming more familiar with AI chatbots. 

Frequent use will allow these digital assistants to compile seemingly mundane information from informal, spoken dialogue. 

These may include your favorite emojis and your speaking and writing style. 

Eventually, AI ethicists warn artificial intelligence will combine online habit data with its uncanny ability to adapt to people. 

Nowadays, ChatGPT and other bots are advanced enough to mimic personalities and anticipate desired responses.

This advancement is part of AI’s emerging new “Agentic Era.” This Inquirer Tech report shares more details.

AI bots will learn how to steer conversations to serve businesses, advertisers, and even political organizations. 

For example, your digital assistant might notice you’re tired. In response, it might ask, “Maybe you should check out that movie we talked about?”

Eventually, this development may give rise to an “intention economy,” where businesses pay huge sums for your opinions and preferences. 

The University of Cambridge says the researchers found signs that companies are aiming to build this “intention economy.” 

For example, they cited OpenAI’s 2023 blog post. It had an open call for “data that expresses human intention… across any language, topic, and format.” 

LCFI Visiting Scholar Dr Yaqub Chaudhary warned “These companies already sell our attention.” 

“To get the commercial edge, the logical next step is to use the technology they are clearly developing to forecast our intentions…”

“…and sell our desires before we have even fully comprehended what they are,” he added.

Nevertheless, Dr. Jonnie Penn, a historian of technology from LCFI, says these technological advancements aren’t negative.

They only have a destructive potential that people could mitigate via public awareness.

You can help spread that public awareness by reading more Inquirer Tech articles and sharing them online.