What would happen if synthetic speech got really good at hacking your emotions?
Sonantic, an AI voice startup, says it’s made a minor breakthrough in its development of audio deepfakes, creating a synthetic voice that can express subtleties like teasing and flirtation. The company says the key to its advance is the incorporation of non-speech sounds into its audio; training its AI models to recreate those small intakes of breath - tiny scoffs and half-hidden chuckles - that give real speech its stamp of biological authenticity.
Examples embedded.
TANGENTIALLY:
The non-speech sounds in the flirty synth-voice are the best bits.
I’m reminded of WaveNet which was the big breakthrough in computer-generated voices in 2016. They also released examples of “babbling” which is when you run the voice machine but without any words. So you ONLY hear half-breaths, the tack of the tongue in the mouth, the subtle echo of the mouth cavity, and so on. It’s incredible audio.
The article asks this question: what are the ethics of deploying a flirtatious AI? Is it fair to manipulate listeners in this way?
That’s the point: it’s coercive, right? Weaponised flirting has long been used by those people who try to get you to sign up to charity donations on the street.
People like flirting which is why it works.
EXAMPLE, this chatbot in China: Xiaoice was first developed by a group of researchers inside Microsoft Asia-Pacific in 2014, before the American firm spun off the bot as an independent business.
And: According to Xiaoice’s creators, the bot has reached over 600 million users. (Mostly Chinese, mostly male.)
Unlike regular virtual assistants, Xiaoice is designed to set her users’ hearts aflutter. Appearing as an 18-year-old who likes to wear Japanese-style school uniforms, she flirts, jokes, and even sexts with her human partners, as her algorithm tries to work out how to become their perfect companion.
The platform capitalism data-growth-profit flywheel at work:
By forming deep emotional connections with her users, Xiaoice hopes to keep them engaged. This will help her algorithm become evermore powerful, which will in turn allow the company to attract more users and profitable contracts.
Generalising this to emotional engagement… flirtation won’t be the right unlock for everyone.
So it’s easy to imagine extending adtech. Adtech means using tons of datapoints to construct a profile of you which means that you are shown ads that you are more likely to elicit a response. For example: knowing that other people in your home location are reading content about interior design, the targeting engine can push you ads for home furnishing.
The profile could be extended to add an emotional profile – do you respond best to flirting, or negging, or imperatives, or status flattery, et cetera.
And then ads would be automatically inflected with a sentiment overlay to change the voice or change the copy of the message to increase the likelihood that you respond.
When voices are synthesised, it kinda doesn’t matter if they’re only slightly more effective at getting you to convert – because you can robo-call a million people at once.
And if synthesising is too hard (because it means solving for computer-generated conversations), then:
Why not build artificial flirtation into call centre software? Operators speak with whatever accent they have and with flat affect, and the machine automatically inflects their words to get you to agree to the broadband bundle upsell or whatever.
(Coercion prosthetics. Could a persuasive voice changer be built into my face mask?)
Inhumanly persuasive centaur deepfakes are going to be wild.
What is the anti-spam analogue in a world of coercive voice manipulation?
I look forward to AirPods with smart transparency mode, a kind of audio firewall (as previously speculated (2021)), with a new “anti enchantment” filter: you hear voices as normal, but with flirting and charisma automatically deducted.
If you enjoyed this post, please consider sharing it by email or on social media. Here’s the link. Thanks, —Matt.
‘Yes, we’ll see them together some Saturday afternoon then,’ she said. ‘I won’t have any hand in your not going to Cathedral on Sunday morning. I suppose we must be getting back. What time was it when you looked at your watch just now?’ "In China and some other countries it is not considered necessary to give the girls any education; but in Japan it is not so. The girls are educated here, though not so much as the boys; and of late years they have established schools where they receive what we call the higher branches of instruction. Every year new schools for girls are opened; and a great many of the Japanese who formerly would not be seen in public with their wives have adopted the Western idea, and bring their wives into society. The marriage laws have been arranged so as to allow the different classes to marry among[Pg 258] each other, and the government is doing all it can to improve the condition of the women. They were better off before than the women of any other Eastern country; and if things go on as they are now going, they will be still better in a few years. The world moves. "Frank and Fred." She whispered something to herself in horrified dismay; but then she looked at me with her eyes very blue and said "You'll see him about it, won't you? You must help unravel this tangle, Richard; and if you do I'll--I'll dance at your wedding; yours and--somebody's we know!" Her eyes began forewith. Lawrence laughed silently. He seemed to be intensely amused about something. He took a flat brown paper parcel from his pocket. making a notable addition to American literature. I did truly. "Surely," said the minister, "surely." There might have been men who would have remembered that Mrs. Lawton was a tough woman, even for a mining town, and who would in the names of their own wives have refused to let her cross the threshold of their homes. But he saw that she was ill, and he did not so much as hesitate. "I feel awful sorry for you sir," said the Lieutenant, much moved. "And if I had it in my power you should go. But I have got my orders, and I must obey them. I musn't allow anybody not actually be longing to the army to pass on across the river on the train." "Throw a piece o' that fat pine on the fire. Shorty," said the Deacon, "and let's see what I've got." "Further admonitions," continued the Lieutenant, "had the same result, and I was about to call a guard to put him under arrest, when I happened to notice a pair of field-glasses that the prisoner had picked up, and was evidently intending to appropriate to his own use, and not account for them. This was confirmed by his approaching me in a menacing manner, insolently demanding their return, and threatening me in a loud voice if I did not give them up, which I properly refused to do, and ordered a Sergeant who had come up to seize and buck-and-gag him. The Sergeant, against whom I shall appear later, did not obey my orders, but seemed to abet his companion's gross insubordination. The scene finally culminated, in the presence of a number of enlisted men, in the prisoner's wrenching the field-glasses away from me by main force, and would have struck me had not the Sergeant prevented this. It was such an act as in any other army in the world would have subjected the offender to instant execution. It was only possible in—" "Don't soft-soap me," the old woman snapped. "I'm too old for it and I'm too tough for it. I want to look at some facts, and I want you to look at them, too." She paused, and nobody said a word. "I want to start with a simple statement. We're in trouble." RE: Fruyling's World "MACDONALD'S GATE" "Read me some of it." "Well, I want something better than that." HoME大香蕉第一时间
ENTER NUMBET 0016www.ichengad.org.cn www.jrgdbf.com.cn www.l55dj.net.cn halujie.com.cn euehur.com.cn www.rcchain.com.cn www.tbtnf.com.cn ocup.com.cn www.ufnews.com.cn wowo1688.com.cn
What would happen if synthetic speech got really good at hacking your emotions?
Examples embedded.
TANGENTIALLY:
The non-speech sounds in the flirty synth-voice are the best bits.
I’m reminded of WaveNet which was the big breakthrough in computer-generated voices in 2016. They also released examples of “babbling” which is when you run the voice machine but without any words. So you ONLY hear half-breaths, the tack of the tongue in the mouth, the subtle echo of the mouth cavity, and so on. It’s incredible audio.
I posted about babbling in 2017 (there’s a description there of how to hear to the samples).
The article asks this question:
That’s the point: it’s coercive, right? Weaponised flirting has long been used by those people who try to get you to sign up to charity donations on the street.
People like flirting which is why it works.
EXAMPLE, this chatbot in China:
And: (Mostly Chinese, mostly male.)
The platform capitalism data-growth-profit flywheel at work:
Generalising this to emotional engagement… flirtation won’t be the right unlock for everyone.
So it’s easy to imagine extending adtech. Adtech means using tons of datapoints to construct a profile of you which means that you are shown ads that you are more likely to elicit a response. For example: knowing that other people in your home location are reading content about interior design, the targeting engine can push you ads for home furnishing.
The profile could be extended to add an emotional profile – do you respond best to flirting, or negging, or imperatives, or status flattery, et cetera.
And then ads would be automatically inflected with a sentiment overlay to change the voice or change the copy of the message to increase the likelihood that you respond.
When voices are synthesised, it kinda doesn’t matter if they’re only slightly more effective at getting you to convert – because you can robo-call a million people at once.
And if synthesising is too hard (because it means solving for computer-generated conversations), then:
Why not build artificial flirtation into call centre software? Operators speak with whatever accent they have and with flat affect, and the machine automatically inflects their words to get you to agree to the broadband bundle upsell or whatever.
(Coercion prosthetics. Could a persuasive voice changer be built into my face mask?)
Inhumanly persuasive centaur deepfakes are going to be wild.
What is the anti-spam analogue in a world of coercive voice manipulation?
I look forward to AirPods with smart transparency mode, a kind of audio firewall (as previously speculated (2021)), with a new “anti enchantment” filter: you hear voices as normal, but with flirting and charisma automatically deducted.