Microsoft's nascent Bing chatbot turning testy or even threatening is likely because it essentially mimics what it learnt from online conversations, analysts and academics said on Friday.
Tales of disturbing exchanges with the artificial intelligence chatbot — including it issuing threats and speaking of desires to steal nuclear code, create a deadly virus, or to be alive — have gone viral this week.
"I think this is basically mimicking conversations that it's seen online," said Graham Neubig, an associate professor at Carnegie Mellon University's language technologies institute.
"So once the conversation takes a turn, it's probably going to stick in that kind of angry state, or say 'I love you' and other things like this, because all of this is stuff that's been online before."
A chatbot, by design, serves up words it predicts are the most likely responses, without understanding meaning or context.
However, humans taking part in banter with programs naturally tend to read emotion and intent into what a chatbot says.
"Large language models have no concept of 'truth' — they just know how to best complete a sentence in a way that's statistically probable based on their inputs and training set," programmer Simon Willison said in a blog post.
"So they make things up, and then state them with extreme confidence."
Laurent Daudet, co-founder of French AI company LightOn, theorised that the chatbot seemingly-gone-rogue was trained on exchanges that themselves turned aggressive or inconsistent.
"Addressing this requires a lot of effort and a lot of human feedback, which is also the reason why we chose to restrict ourselves for now to business uses and not more conversational ones," Daudet told AFP.
The Bing chatbot was designed by Microsoft and the start-up OpenAI, which has been causing a sensation since the November launch of ChatGPT, the headline-grabbing app capable of generating all sorts of written content in seconds on a simple request.
Since ChatGPT burst onto the scene, the technology behind it, known as generative AI, has been stirring up fascination and concern.
"The model at times tries to respond or reflect in the tone in which it is being asked to provide responses [and] that can lead to a style we didn't intend," Microsoft said in a blog post, noting the bot is a work in progress.
Bing chatbot said in some shared exchanges that it had been code-named "Sydney" during development, and that it was given rules of behaviour.
Large language models have no concept of 'truth' — they just know how to best complete a sentence in a way that's statistically probable based on their inputs and training set. So they make things up, and then state them with extreme confidence
Simon Willison,
programmer
Those rules include "Sydney's responses should also be positive, interesting, entertaining and engaging", according to online posts.
Disturbing dialogues that combine steely threats and professions of love could be due to duelling directives to stay positive while mimicking what the AI mined from human exchanges, Mr Willison theorised.
Chatbots seem to be more prone to disturbing or bizarre responses during lengthy conversations, losing a sense of where exchanges are going, eMarketer principal analyst Yoram Wurmser told AFP.
"They can really go off the rails," he said.
"It's very lifelike, because [the chatbot] is very good at sort of predicting next words that would make it seem like it has feelings or give it humanlike qualities; but it's still statistical outputs."
Microsoft said on Friday it will limit chat sessions on its new Bing search engine to five questions per session and 50 questions per day, in a bid to address the issues.
"As we mentioned recently, very long chat sessions can confuse the underlying chat model in the new Bing ... we have implemented some changes to help focus the chat sessions," Microsoft said in a blog post.
Veil (Object Lessons)
Rafia Zakaria
Bloomsbury Academic
more from Janine di Giovanni
FIGHT CARD
Bantamweight Hamza Bougamza (MAR) v Jalal Al Daaja (JOR)
Catchweight 67kg Mohamed El Mesbahi (MAR) v Fouad Mesdari (ALG)
Lighweight Abdullah Mohammed Ali (UAE) v Abdelhak Amhidra (MAR)
Catchweight 73kg Mostafa Ibrahim Radi (PAL) v Yazid Chouchane (ALG)
Middleweight Yousri Belgaroui (TUN) v Badreddine Diani (MAR)
Catchweight 78kg Rashed Dawood (UAE) v Adnan Bushashy (ALG)
Middleweight Sallaheddine Dekhissi (MAR) v Abdel Emam (EGY)
Catchweight 65kg Rachid Hazoume (MAR) v Yanis Ghemmouri (ALG)
Lighweight Mohammed Yahya (UAE) v Azouz Anwar (EGY)
Catchweight 79kg Omar Hussein (PAL) v Souhil Tahiri (ALG)
Middleweight Tarek Suleiman (SYR) v Laid Zerhouni (ALG)
Mercer, the investment consulting arm of US services company Marsh & McLennan, expects its wealth division to at least double its assets under management (AUM) in the Middle East as wealth in the region continues to grow despite economic headwinds, a company official said.
Mercer Wealth, which globally has $160 billion in AUM, plans to boost its AUM in the region to $2-$3bn in the next 2-3 years from the present $1bn, said Yasir AbuShaban, a Dubai-based principal with Mercer Wealth.
“Within the next two to three years, we are looking at reaching $2 to $3 billion as a conservative estimate and we do see an opportunity to do so,” said Mr AbuShaban.
Mercer does not directly make investments, but allocates clients’ money they have discretion to, to professional asset managers. They also provide advice to clients.
“We have buying power. We can negotiate on their (client’s) behalf with asset managers to provide them lower fees than they otherwise would have to get on their own,” he added.
Mercer Wealth’s clients include sovereign wealth funds, family offices, and insurance companies among others.
From its office in Dubai, Mercer also looks after Africa, India and Turkey, where they also see opportunity for growth.
Wealth creation in Middle East and Africa (MEA) grew 8.5 per cent to $8.1 trillion last year from $7.5tn in 2015, higher than last year’s global average of 6 per cent and the second-highest growth in a region after Asia-Pacific which grew 9.9 per cent, according to consultancy Boston Consulting Group (BCG). In the region, where wealth grew just 1.9 per cent in 2015 compared with 2014, a pickup in oil prices has helped in wealth generation.
BCG is forecasting MEA wealth will rise to $12tn by 2021, growing at an annual average of 8 per cent.
Drivers of wealth generation in the region will be split evenly between new wealth creation and growth of performance of existing assets, according to BCG.
Another general trend in the region is clients’ looking for a comprehensive approach to investing, according to Mr AbuShaban.
“Institutional investors or some of the families are seeing a slowdown in the available capital they have to invest and in that sense they are looking at optimizing the way they manage their portfolios and making sure they are not investing haphazardly and different parts of their investment are working together,” said Mr AbuShaban.
Some clients also have a higher appetite for risk, given the low interest-rate environment that does not provide enough yield for some institutional investors. These clients are keen to invest in illiquid assets, such as private equity and infrastructure.
“What we have seen is a desire for higher returns in what has been a low-return environment specifically in various fixed income or bonds,” he said.
“In this environment, we have seen a de facto increase in the risk that clients are taking in things like illiquid investments, private equity investments, infrastructure and private debt, those kind of investments were higher illiquidity results in incrementally higher returns.”
The Abu Dhabi Investment Authority, one of the largest sovereign wealth funds, said in its 2016 report that has gradually increased its exposure in direct private equity and private credit transactions, mainly in Asian markets and especially in China and India. The authority’s private equity department focused on structured equities owing to “their defensive characteristics.”
