A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • Marxism-Fennekinism@lemmy.ml
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    1 year ago

    Maybe I’m just naive of how many protections we’re actually granted but shouldn’t this already fall under CP/CSAM legislation in nearly every country?

          • Nyanix@lemmy.ca
            link
            fedilink
            arrow-up
            2
            ·
            1 year ago

            While you’re correct, many of these generators are retaining the source image and only generating masked sections, so the person in the image is still themselves with effectively photoshopped nudity, which would still qualify as child pornography. That is an interesting point that you make though

          • Basil@lemmings.world
            link
            fedilink
            arrow-up
            2
            arrow-down
            1
            ·
            edit-2
            1 year ago

            What? But they literally do exist, and they’re hurting from it. Did you even read the post?

          • DogMuffins@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            0
            arrow-down
            2
            ·
            1 year ago

            Of course they exist. If the AI generated image “depicts” a person, a victim in this case, that person “by definition” exists.

            Your argument evaporates when you consider that all digital images are interpreted and encoded by complex mathematical algorithms. All digital images are “fake” by that definition and therefore the people depicted do not exist. Try explaining that to your 9 year old daughter.

                  • DogMuffins@discuss.tchncs.de
                    link
                    fedilink
                    English
                    arrow-up
                    2
                    arrow-down
                    1
                    ·
                    1 year ago

                    This is so tedious. If you have a point, then make it. Stop asking inane questions.

                    So do people in images that are purely AI generated exist, or not?

                    This question is based on a false premise, as though the technology used to create an image is relevant to what it depicts.

                    • If michaelangelo paints the likeness of a model, does the model in the image exist?
                    • if a child draws a stick figure likeness of their dad, does the dad in the image exist?
                    • if you take a photo on your phone, and it uses complex mathematical algorithms to compress and later render the image, do people in those images exist?
                    • if you run a filter over that image on your phone, does that person still exist ?

                    Of course in all cases, for all intents and purposes the depicted person exists. You can argue that a painting is just an arrangement of pigments on canvas and you would be correct, but to everyone else its still a picture of a specific person.

                    If you use a computer to generate an image that “looks like” a school-mate doing whatever thing, then an argument that the person in the picture does not exist because the image was generated by AI is moot, because for all intent’s and purposes it’s a “picture of” that school mate doing that thing.

              • Taco@lemmy.zip
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                You fucking dunce. You did not read the article. People have been taking real pictures of real children, and using AI to remove their clothes. The real person is still in the image

        • rchive@lemm.ee
          link
          fedilink
          arrow-up
          0
          arrow-down
          1
          ·
          1 year ago

          If you make a picture today of someone based on how they looked 10 years ago, we say it’s depicting that person as the age they were 10 years ago. How is what age they are today relevant?

        • rchive@lemm.ee
          link
          fedilink
          arrow-up
          0
          arrow-down
          2
          ·
          1 year ago

          If you make a picture today of someone based on how they looked 10 years ago, we say it’s depicting that person as the age they were 10 years ago. How is what age they are today relevant?

      • Fal@yiffit.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Won’t somebody think of the make believe computer generated cartoon children?!

        • legios@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Australia too. Hentai showing underage people is illegal here. From my understanding it’s all a little grey depending on the state and whether the laws are enforced, but if it’s about victimisation the law will be pretty clear.

          • Fal@yiffit.net
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            1 year ago

            Absolutely absurd. Criminalizing drawings is the stupidest thing in the world.

            This case should already be illegal under harassment or similar laws. There’s no reason to make drawings illegal