A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.
Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.
The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.
Honest opinion:
We should normalize nudity.
That’s the only healthy relationship that we can have with our bodies in the long term.
Having spent many years in both the US and multiple European countries, I can confidently say that the US has the weirdest, most unnatural, and most unhealthy relationship with nudity.
This isn’t even the problem going on, though? Sure, normalize nudity, whatever, that doesn’t fix deep faked porn of literal children.
It’s the idea that people may be less sexually depraved if we normalize people being naked. Duh. In my opinion the whole world just needs to normalize sexuality across the board. I think it would solve many of society’s problems, frankly
Why is that a problem though? Youre allowed to draw a picture of a specific child naked, why is it suddenly a crime if you use a computer to do it really well?
I shouldn’t have to answer this
There’s a pretty big fucking difference between normalizing nudity and people putting the faces of 14 year olds in porn video through deepfakes.
For this to happen people would probably need to stop judging people on their bodies. I am pretty sure there is a connection there. With how extremely superficial media and many relationships are, and with how we value women in particular, this needs a lot of change in people and society.
I also think it would be a good thing, but we still have to do something about it until we reach that point.
deleted by creator
Maybe I’m just naive of how many protections we’re actually granted but shouldn’t this already fall under CP/CSAM legislation in nearly every country?
Would it? How do they prove the age of an AI generated image?
By… checking the age of the person depicted in the image?
…who by definition is AI generated and does not, in fact, exist?
While you’re correct, many of these generators are retaining the source image and only generating masked sections, so the person in the image is still themselves with effectively photoshopped nudity, which would still qualify as child pornography. That is an interesting point that you make though
What? But they literally do exist, and they’re hurting from it. Did you even read the post?
Of course they exist. If the AI generated image “depicts” a person, a victim in this case, that person “by definition” exists.
Your argument evaporates when you consider that all digital images are interpreted and encoded by complex mathematical algorithms. All digital images are “fake” by that definition and therefore the people depicted do not exist. Try explaining that to your 9 year old daughter.
Go to this website and tell me who is depicted in the photo, please?
Are you daft? I assume that the person depicted in the photo at thispersondoesnotexist.com does not exist.
That image was generated by AI.
So do people in images that are purely AI generated exist, or not?
You fucking dunce. You did not read the article. People have been taking real pictures of real children, and using AI to remove their clothes. The real person is still in the image
If you make a picture today of someone based on how they looked 10 years ago, we say it’s depicting that person as the age they were 10 years ago. How is what age they are today relevant?
You mean the real person being depicted? So this wouldn’t apply to fake people?
Which fake people?
If the porn were of non-real people.
You can’t ask questions on lemmy - people assume you have lots of subtext that isn’t there.
If you make a picture today of someone based on how they looked 10 years ago, we say it’s depicting that person as the age they were 10 years ago. How is what age they are today relevant?
Won’t somebody think of the make believe computer generated cartoon children?!
In Germany, it would.
Not a lawyer, but 99% sure it’s the same here in Canada as well.
Australia too. Hentai showing underage people is illegal here. From my understanding it’s all a little grey depending on the state and whether the laws are enforced, but if it’s about victimisation the law will be pretty clear.
Absolutely absurd. Criminalizing drawings is the stupidest thing in the world.
This case should already be illegal under harassment or similar laws. There’s no reason to make drawings illegal
Maybe it is just me, but its why I think this is a bigger issue than just Hollywood.
The rights to famous people’s “images” are bought and sold all the time.
I would argue that the entire concept should be made illegal. Others can only use your image with your explicit permission and your image cannot be “owned” by anyone but yourself.
The fact that making a law like this isn’t a priority means this will get worse because we already have a society and laws that don’t respect our rights to control of our own image.
A law like this would also remove all the questions about youth and sex and instead make it a case of misuse of someone else’s image. In this case it could even be considered defamation for altering the image to make it seem like it was real. They defamed her by making it seem like she took nude photos of herself to spread around.
There are genuine reasons not to give people sole authority over their image though. “Oh that’s a picture of me genuinely doing something bad, you can’t publish that!”
Like, we still need to be able to have a public conversation about (especially political) public figures and their actions as photographed
Yeah I’m not stipulating a law where you can’t be held accountable for actions. Any actions you take as an individual are things you do that impact your image, of which you are in control. People using photographic evidence to prove you have done them is not a misuse of your image.
Making fake images whole cloth is.
The question of whether this technology will make such evidence untrustworthy is another conversation that sadly I don’t have enough time for right this moment.
That sounds pretty dystopian to me. Wouldn’t that make filming in public basically illegal?
In Germany it is illegal to make photos or videos of people who are identifieable (faces are seen or closeups) without asking for permission first. With exception of public events, as long as you do not focus on individuals. It doesn’t feel dystopian at all, to be honest. I’d rather have it that way than ending up on someone’s stupid vlog or whatever.
gee here is a novel idea, dont let children have access to social media. that would solve a lot of other problems also
While I agree with that in principle, we shouldn’t start blocking people, even young people, access to a lot of information.
Twitter, while now a cesspool, still has a lot of academics on it that share new ideas and discoveries.
Reddit, while shit, also has the value of helping people find niche hobbies and communities.
YouTube, while turning into shit, allows people access to video tutorials and explanations, hell while I was in school half the time teachers assigned hw that we would need to watch a YouTube video.
While it’s an idea to block the youth from accessing social media, the drawbacks I think are too much.
It’s time for the butlerian jihad.
Sounds like an easy fix, treat it as revenge porn and CEM and prosecute it exactly the same.
Little Timmy’s gonna think twice about distributing stable diffusions of the cheerleaders after he sees mikey’s life get ruined for that shit
I don’t think kids think about consequences in this way. Also not sure if charging a 12 year old as a paedophile is the right move.
The problem is how to actually prevent this. What could one do? Make AI systems illegal? Make graphics tools illegal? Make the Internet illegal? Make computers illegal?
By dishing out punishment that really hurts.
Severity of punishment works poorly. Inevitability, on the other hand…
I think in this case less mild punishment would send the appropriate signal that this isn’t just a little joke or a small misdemeanor.
There are still way too many people who believe sexual harassment etc. aren’t that huge of a deal. And I believe the fact that perpetrators so easily get away with it plays into this.
(I am not sure how it is in the US, in my country the consequence of crimes against bodily autonomy are laughable.)
Average American be like
I fail to see why fake nudes existing harms them in any way, just as drawing a nude of someone from the imagination would not harm them in any way.
Laws about sexuality and youth are meant to protect the youth, and in this case they are not subjected to any harm, except possibly social stigmatization because we are weird about sex and nudity. Maybe this technology will lead us to be better about it and less weird.
I’m not sure if you’re trolling or not here or just lacking empathy.
Imagine a believable image, let alone video, of you with your full name and age on it participating in a burning cross ceremony in a white hood propagating through the internet.
This isn’t just some situation where it stays on a single person’s computer—it gets shared. And is effectively unstoppable.
I’m not claiming of knowing a way to handle this situation, but your comment is really confusing to me that you don’t understand the harms here.
Well this technology is going to make said photos not believable, isn’t it?
So that means it will make all images and videos not believable. That’s serious dystopian shit.
Trust no one. Everything is fake. Nothing is real.
Unfortunately that’s the road we’re headed down, and if there’s an off-ramp I don’t see it. Photo and video evidence alone will not be sufficient to prove claims in the near future.
reading this, I don’t really know what is supposed to be protected here to be deemed possible of protections in the first place.
closest reasonable one is the girl’s “identity”, so it could be fraud. but it’s not used to fool people. more likely, those getting the pics already consented this is ai generated.
so might be defamation?
the image generation tech is already easily accessible so the girl’s picture being easily accessible might be the weakest link?
Not a lawyer, but I’ll take a stab. Pretty sure it’s illegal to create sexual images of children, photos or not. It’s also illegal to use someone’s likeness without permission, but admittedly this depends on the state in the US: https://en.wikipedia.org/wiki/Personality_rights
Pretty sure it’s illegal to create sexual images of children, photos or not.
Maybe in your distopian countries where drawings are illegal. Absolutely absurd you’re promoting that as a good thing.
I’m not exactly sure what your point is. In the article, a kid created an unwanted sexual depiction of another kid and spread it around. I do think that should be illegal.
Yes but this thread is about just drawings in general. Deep faking someone into porn and spreading it around should absolutely be yourself. But it’s not “child porn”. It’s some type of harassment or defamation or something
AI bad
Addendum, Closed Source AI.
Open source AI would be even worse.
According to what logic? Like I’m ever going to trust some lying asshole to hide his instructions for fucking anything that’s MINE. News Alert: “Your” computer ain’t yours.
People have been trying to circumvent chatGPT’s filters, they’ll do the exact same with open source AI. But it’ll be worse because it’s open source, so any built in feature to prevent abuse could just get removed then recompiled by whoever.
And that’s all even assuming there ever ends up being open source AI.
You’re logic is bass ackwards. Knowing the open source publicly means the shit gets fixed faster. Closed source just don’t get fixed %99 of the time because there’s only one mother fucker to do the fixing and usually just don’t do it.
You can’t fix it with open source. All it takes is one guy making a fork and removing the safeguards because they believe in free speech or something. You can’t have safeguards against misuse of a tool in an open source environment.
I agree that closed source AI is bad. But open source doesn’t magically solve the problem.
Forks are productive. Your’re just wrong about it. I’ll take FOSS over closed source. I’ll trust the masses reviewing FOSS over the one asshole doing, or rather not doing, exactly that.
In previous generations the kid making fake porn of their classmates was not a well liked kid. Is that reversed now? On the basis of quality of tech?
