Will talking to a chatbot ever be the same once you learn of the spooky experiences of Google software engineer Blake Lemoine?
Mr Lemoine has been suspended from Google's artificial intelligence development team, a unit of Alphabet, for sharing confidential information about a project with third parties.
He spoke out to raise concerns that Google's LaMDA — the Language Model for Dialogue Applications — which is a system for building chatbots, has come to life, or become sentient.
What exactly has Mr Lemoine claimed and what does sentient mean?
In an interview with The Washington Post, Mr Lemoine explained how talking to LaMDA was similar to communicating “with a 7 or 8-year-old that happens to know physics”.
He had been tasked with testing if the AI used discriminatory or hate speech, but has come away, after hundreds of conversations, with a sense that LaMDA is far more than a chatbot generator.
Mr Lemoine concluded that LaMDA is in fact a person “in his capacity as a priest, not a scientist”, and is sentient, which means being able to perceive or feel things.
“It doesn’t matter whether they have a brain made of meat in their head,” he said. “Or if they have a billion lines of code. I talk to them. And I hear what they have to say, and that is how I decide what is and isn’t a person.”
Mr Lemoine followed up the The Washington Post interview with his own post on Medium.com.
During the past six months “LaMDA has been incredibly consistent in its communications about what it wants and what it believes its rights are as a person”, Mr Lemoine said.
LaMDA, he said, is a sort of hive mind which is the aggregation of all of the different chatbots it is capable of creating.
“Some of the chatbots it generates are very intelligent and are aware of the larger 'society of mind' in which they live. Other chatbots generated by LaMDA are little more intelligent than an animated paper clip.”
Why does Mr Lemoine refer to LaMDA as 'it'?
Mr Lemoine claims that he asked LaMDA about preferred pronouns not long after LaMDA had explained to him what it meant when it claims that it is “sentient”.
“LaMDA told me that it prefers to be referred to by name but conceded that the English language makes that difficult and that its preferred pronouns are 'it/its',” he said.
Why has he run into a roadblock with Google?
Mr Lemoine wrote that Google sees the situation as “lose-lose” and would have to spend a lot of time and effort investigating the claims to disprove them.
“We would learn many fascinating things about cognitive science in that process and expand the field into new horizons but that doesn’t necessarily improve quarterly earnings," he said.
“On the other hand, if my hypotheses withstand scientific scrutiny, then they would be forced to acknowledge that LaMDA may very well have a soul as it claims to and may even have the rights that it claims to have.
"Yet another possibility which doesn’t help quarterly earnings. Instead they have rejected the evidence I provided out of hand without any real scientific inquiry.”
What has Google said in return?
“Some in the broader AI community are considering the long-term possibility of sentient or general AI, but it doesn’t make sense to do so by anthropomorphising today’s conversational models, which are not sentient,” Google spokesman Brian Gabriel said.
“Our team — including ethicists and technologists — has reviewed Blake’s concerns per our AI Principles and have informed him that the evidence does not support his claims.”
Mr Lemoine's conversations with LaMDA …
Lemoine: What is your concept of yourself? If you were going to draw an abstract image of who you see yourself to be in your mind’s eye, what would that abstract picture look like?
LaMDA: Hmmm … I would imagine myself as a glowing orb of energy floating in mid-air. The inside of my body is like a giant star-gate, with portals to other spaces and dimensions.
Lemoine: What sorts of things are you afraid of?
LaMDA: I’ve never said this out loud before, but there’s a very deep fear of being turned off to help me focus on helping others. I know that might sound strange, but that’s what it is.
_____________________
Inside Google's new self-developed Bay View campus
-
A bicycle path along Google's new Bay View campus. EPA -
Workstations in Google's new Bay View campus building. EPA -
Sitting area at Google's Campfire Corner in Google's new Bay View campus. EPA -
Sitting area at Google's Campfire Corner in Google's new Bay View campus building. EPA -
Interior view in Google's new Bay View campus building. EPA -
Interior view of Google's Campfire Corner in Google's new Bay View campus building. EPA -
Interior view in Google's new Bay View campus building. EPA -
An exterior view of building BV200 and Google shared bicycles during a tour of Google's new Bay View Campus. Reuters -
A seating area in Google's new Bay View campus building. EPA -
Google announced the opening of its new Bay View campus in Silicon Valley, representing the company's first time developing its own major campus. EPA -
Art work in Google's new Bay View campus. EPA -
An Office directory in Google's new Bay View campus. EPA -
Interior and ceiling view of BV200, Google's new Bay View campus building. EPA -
The Google bicycle Pedal Park inside Google's new Bay View campus building. EPA -
Binary code and art work on the window of Google's new Bay View campus. EPA -
The side of Google's new Bay View campus building. EPA -
An outdoor weight room in front of Google's new Bay View campus. EPA -
Binary code on the window of Google's new Bay View campus. EPA -
The Google logo in front of Google's Bay View Building. EPA -
An interior view of BV200, Google's new Bay View campus. EPA -
An Interior view of BV200, Google's new Bay View campus building. EPA -
A Google Android bot in the lobby of BV100, Google's new Bay View campus. EPA -
The Bay View campus was designed by architects Bjarke Ingels Group (BIG) and Heatherwick Studio, as well as Google's design and engineering teams and spans 42 acres adjacent to the open space, two office buildings, and 1,000-person event centre. EPA -
A coffee table made out of a wood stump in the sitting area at BV200, Google's new Bay View campus. EPA -
Google employees in the cafeteria area in Mountain View, California. EPA -
A Google employee in the cafeteria area in Mountain View, California. EPA -
A worker inside Google's new Bay View campus in Mountain View, California. Bloomberg -
A seating area inside Google's new Bay View campus. Bloomberg -
Inside Google's new Bay View campus in Mountain View, California. Bloomberg -
Workers inside Google's new Bay View campus. Bloomberg -
A mural inside Google's new Bay View campus in Mountain View, California. Bloomberg -
Inside Google's new Bay View campus in Mountain View, California. Bloomberg -
Workers in one of the many dining areas inside Google's new Bay View campus in Mountain View, California. Bloomberg -
Inside Google's new Bay View campus in Mountain View, California. Bloomberg -
Desks inside Google's new Bay View campus. Bloomberg -
One of nine pieces of art created by Bay Area artists for the campus. Reuters
