43

Meta announced a new AI model called Voicebox yesterday, one it says is the most versatile yet for speech generation, but it’s not releasing it yet: The model is still only a research project, but Meta says can generate speech in six languages from samples as short as two seconds and could be used for “natural, authentic” translation in the future, among other things.

top 26 comments
sorted by: hot top controversial new old
[-] Ronno@kbin.social 23 points 1 year ago

Since when is Meta considering something as being too dangerous? It is not like Facebook and Instagram are any less dangerous...

[-] Wander@kbin.social 5 points 1 year ago

What they mean is, they're worried about bad press

[-] zhaosima@kbin.social 3 points 1 year ago

It's just supposed to add to the hype: tHis AI cAn dEStroY teh woRld!!

[-] Steeve@lemmy.ca 1 points 1 year ago* (last edited 1 year ago)

Lol what? Of course they're less dangerous. I don't have to worry about someone using a 2 second clip of audio to scam my grandma into thinking I'm trapped in a foreign country and sending over thousands of dollars using Facebook.

Facebook and Instagram have what? Targeted ads? Yeah I'll take my chances there

[-] Ronno@kbin.social 2 points 1 year ago

The way Meta gathers and processes not only user information, but also non-user information, from all corners of the internet is astonishing. Meta mainly uses this information for targeted ads, which in its core isn't all that harmful. However, there appear to be cases in which social media is crawled to "tailor" a product, which is not desirable for consumers. E.g. when you watch a lot of car/motorcycle stunt content, it might ultimately mean that your next car insurance payment will be higher, because the insurer thinks that you might start doing that dumb stuff too. That is probably the least scary use case.

What really is the most dangerous is what you saw over the last couple of years, Social media platforms being used to manipulate people and push a specific (geo)political agenda. We also have echo chambers of communities that can potentially be harmful to society. All of this, combined with the data that Meta gathers is dangerous beyond comprehension.

Couple that to your statement "I don't have to worry about someone using a 2 second clip of audio to scam my grandma into thinking I'm trapped in a foreign country and sending over thousands of dollars using Facebook." Even without AI, this has happened over the past years using social media platforms. Scammers and thieves know when you are not at home, because you are posting those holiday pictures. When a data leak occurs, which happens quite often, scammers and thieves get access to your historical information and patterns, which can also be used to scam your grandma, or worse. It is quite easy to social hack someone when you know pretty much everything that happened in that persons life. "Hey grandma, sending this message from a strange phone number from Bali, since someone stole my phone on the beach, can you send over some money to buy a new one?".

Not saying we shouldn't use social media anymore, I am also posting this on one. But people should be mindful of the information that is out there.

[-] shoelace@kbin.social 9 points 1 year ago

Gives me Simpsons vibes.

Chalmers: Ah- Aurora Borealis!? At this time of year, at this time of day, in this part of the country, localized entirely within your kitchen!?
Skinner: Yes.
Chalmers: ...May I see it?
Skinner: ...No.

[-] diabolic_seagull@kbin.social 7 points 1 year ago

it seems to be the next wave of marketing: "our stuff is just so good it would be dangerous to release"

[-] PabloDiscobar@kbin.social 5 points 1 year ago* (last edited 1 year ago)

"Our tech is so powerful that it's dangerous!"

"Ok, seems like we will have to push for more regulations into laws then"

"No, wait!"

[-] ConfusedLlama@kbin.social 7 points 1 year ago

Sure it won't somehow leak out 👀

[-] Kbin_space_program@kbin.social 6 points 1 year ago

Actually natural and authentic, or what Zuckerberg considers natural and authentic?

[-] justinalanbass@kbin.social 6 points 1 year ago

Maybe this one filters out fake news too well.

[-] Otome-chan@kbin.social 6 points 1 year ago

annoying. why do they never release good voice clone tts? moegoe and tortoise are the best we have pretty much.

[-] blaine@kbin.social 5 points 1 year ago

Mark Zuckerberg was on the Lex Friedman podcast less than a week ago talking about this, and he said meta would continue to open source their models until they reach the point of "super intelligence".

So what changed in the last week?

[-] Clairvoidance@kbin.social 3 points 1 year ago* (last edited 1 year ago)

That was specifically around LLMs. In that same podcast he also highlighted how scams are very worrisome and you can probably extend that to any reality-faking technology as it gets more and more convincing.
It's self explanatory that the threat of extinction by AI and threat of crafting a fake reality to shape the outcome of the real reality are two different threats

[-] Maeve@kbin.social 2 points 1 year ago

Ok, following you, only commenter so far. Your posts are thought-experiment inducing. Thank you!

[-] Clairvoidance@kbin.social 2 points 1 year ago

I well enjoyed our talk together too! Though just beware i might definitely post cringe shit on topics you don't care about

[-] Maeve@kbin.social 2 points 1 year ago

Oh well, we’ll see how it goes. Cheers!

[-] blaine@kbin.social 2 points 1 year ago

So creating a text-based AI that impersonates influencers or celebrities is a "cool feature" to "increase engagement" and is totally viable to release to the public, but doing the (checks notes) same thing using voice is incredibly "dangerous" and needs to be protected?

[-] conciselyverbose@kbin.social 2 points 1 year ago

People understand that text can be fake.

People don't really understand that voices can be. It's opening up a lot of scams with people pretending to be kidnapped (or otherwise desperate) relatives and taking money from people. If you make it easier to automate that without the human in play and have it appear responsive? A lot more is going to happen a lot more convincingly.

I don't at all believe Facebook cares about that, but it is a real downside to the tech.

[-] Clairvoidance@kbin.social 2 points 1 year ago* (last edited 1 year ago)

Well snarked, especially enjoyed the copypaste of the checking notes phenomena. Can you figure out why one would be seen as more harmful in the immediate future than the other?

[-] EmptyRadar@kbin.social 5 points 1 year ago

What a fantastic way to phrase "we don't have a public release anywhere near ready yet". They need to give that PR person a raise.

[-] stochastictrebuchet@kbin.social 5 points 1 year ago

Taking a page out of OpenAI’s book, I see

[-] Liontigerwings@kbin.social 4 points 1 year ago

Turns out any time you've heard Zuckerberg over the last 10 years it was actually this ai voice model.

[-] Clairvoidance@kbin.social 3 points 1 year ago

Wake me up when we can do real-time or close-to-realtime speech generation

[-] lohrun@fediverse.boo 1 points 1 year ago

I’ve personally messed around with ElevenLabs and their voice generation, and I was honestly amazed. I even did an experiment by running a fully AI YouTube channel for a couple weeks. I wouldn’t be surprised if a massive company like Facebook was able to pull off a realistic sounding voice.

load more comments
view more: next ›
this post was submitted on 19 Jun 2023
43 points (100.0% liked)

Technology

165 readers
1 users here now

This magazine is dedicated to discussions on the latest developments, trends, and innovations in the world of technology. Whether you are a tech enthusiast, a developer, or simply curious about the latest gadgets and software, this is the place for you. Here you can share your knowledge, ask questions, and engage in discussions on topics such as artificial intelligence, robotics, cloud computing, cybersecurity, and more. From the impact of technology on society to the ethical considerations of new technologies, this category covers a wide range of topics related to technology. Join the conversation and let's explore the ever-evolving world of technology together!

founded 2 years ago