Add marketplace policy regarding AI generated content
Chaser Zaks
So going into this, I want to disclaim that I myself am not against AI. I personally have used it before, and will do so in the future. A specific chat AI helps me regularly with solving problems.
However, I am against people intentionally misleading people about content, and polluting search results with content made in mere seconds, and find it no different than spam. If I made something that randomly generated randomly colored squares on a white canvas, and listed it a dozen or so times, it'd be seen as spam.
Additionally, this issue was brought up in the SL Discord marketplace chat. I've moved it here so that it can get more recognition and visibility to LL.
Personally, I believe that a policy worded like so would benefit everyone in the long run (canny has messed up some formatting here, so it looks like it has no line breaks, these have been substituted with "---" for readability)
Content that is the sole generation of Artificial Intelligence, Machine Learning, or otherwise Generative Content, except in the cases where the generator was written for the sole purpose of generating a specific element, may not be listed on the Marketplace as-is or as the focal point of the content that is listed.
---
AI images must never be used to generate listing images, and must be presented as the content appears in SL. Overlays, such as permission information, price, branding labels, or sales labels, are permitted as much so as they do not mis-represent the content that is being advertised.
---
Examples of forbidden listings:
* In singular or collection, AI generated content as a texture, image, mesh, sound or other type of asset, as the sole content being listed.
* A AI generated image in a picture frame.
* A museum prefab filled with AI generated images as a "ready to go" model.
* A object that plays randomly generated AI voice clips.
* Attempting to pass off or mislead people that AI generated content as original, hand crafted content.
* A listing which shows a AI enhanced product preview.
---
Examples of allowed listings:
* A house that has a AI generated poster in it, where the poster is not the selling point of the house.
* A museum model that has some AI generated images, or is focused on the topic of AI generated content.
* A NPC, that among other features, plays AI generated voice clips.
* A model that has AI generated textures, where the model is not AI generated.
---
Listings that make use of 50% or more in it's creation must be clearly labeled as using AI generation or assistance in the listing description. Interpretation of what counts as "50% or more is" left solely to Linden Lab.
Listings that use AI but under the 50% threshold are recommended, but not required, to disclose that AI is used in some capacity.
In summary, it forbids listing of content on the marketplace, free or for sale, that is entirely AI generated, requires disclosure of AI generated content when AI does a majority of the work, and guards against some loopholes.
This probably (as in, very likely. I feel this is implied, but just in case) isn't needed, but: Because this will probably get passed by the lawyers, I hereby grant all permission to Linden Lab to use or transform the above work in any way, without attribution or compensation.
Linden Lab has the opportunity to deal with this now before it gets too out of control. Only a handful of residents would be in violation of this policy.
This also only applies to marketplace stuff, not in-world content.
Log In
Philip Linden
Would a simpler idea be to simply require that marketplace listing pictures need to be actual in-world screenshots of the content? That seems relatively easy to enforce.
Having LL take the position that "AI-generated pictures in picture frames are not welcome in SL" seems very aggressive and something that I would want a vote of the entire population to get behind. Additionally, as discussed at the meeting, I believe that no software currently exists that could identify an "AI" picture, meaning that this would substantially increase support costs were we to hire people to investigate content that looked like AI.
Chaser Zaks
Philip Linden I appreciate the comment! Simply adding requirement that product listing images must consist of in-world content and not be "enhanced" in any way (aside from like, putting product detail overlays) would be a BIG improvement!
I do agree that "AI generated pictures in picture frames" restriction is a bit aggressive, my examples were more so for general ideas of things I've heard around.
I think that by adding the aforementioned simpler idea, as well as a requirement for content that is made using 50% or more of AI in the process be marked as AI would satisfy a good majority of the residents who have specific feelings about AI.
I fully understand that content moderation would be a big hassle when it comes to checking if something is AI or not, in fact AI has been improving so much that it is getting more difficult to tell. Which is why it'd mostly be a "good faith" marketplace listing attribute, similar to how marking content is 100% mesh.
Despite the difficulty of moderation, the checkbox should be added regardless, with self reporting being the expectation.
Of course, there are ways to determine if something is obviously AI enhanced (EG: A dress that looks nothing like it does in the picture), which should be enforceable to some capacity.
Again, I really do appreciate the comment and reaching out to the community about this!
Devilgrey Resident
finally getting an Ai-roundtable. make sure to submit your concerns to the lidens here too
Pierre Ceriano
All of this stems from a utopia and a clear lack of realism, with fear as a shroud. Don't take everything I'm about to write as personal attacks, because that's not my point here, just my opinion.
Utopia: Linden Labs can't prevent assets stolen from external libraries from being brought in. They could do it if they provided the human resources, but that's never been the case. How do you expect them to provide the resources : one, to recognize an AI, two, to prevent it from entering SL?
Lack of realism regarding the creation of meshes from AI. It's important to understand that AI produces "big messes" that then need to be reworked, sometimes entirely: between overlapping UVs and holes that need to be filled, AI users quickly understand that other skills are required besides writing prompts (which, incidentally, eliminates anyone who can't string three words together in a sentence...). As of today, I've tested most generative tools (the paid versions) and I spend a hundred times more time redoing the AI's work than writing the prompt or finding an image to work from. I can't afford to offer unfinished products ; most of the time, I completely redo the mesh... What's the point?
Fear. Especially that of creators (of which I am modestly one). This fear already existed when we moved from primitives to sculpts, then from sculpts to meshes, and today, meshes with the help of AI. The fear of being overtaken, of becoming obsolete. Everyone deals with fear in their own way ; for me, AI provokes more excitement than fear. I see it as a challenge, a way (so far unfinished) to unleash my creativity.
As for informing users of the total or partial presence of AI in my creations, well, I do the same as for GMOs, I indicate it on the box, so as to avoid any legal action or class action in the event of allergic reactions...
Chaser Zaks
Pierre Ceriano I actually use and enjoy AI. For me it is less so of fear, and more so that I want people to stop misleading people, especially so by using AI to "enhance" the product images. If I am buying something, I expect to buy what I am seeing in the image. If I buy something that doesn't look at all like the product image, I would feel mislead.
Pierre Ceriano
Thanks, Chaser Zaks, for contributing to the discussion. I also don't like buying something that doesn't match the seller's advertising. And besides, it's not just the image ; it's also what's written in the "Details" section. This doesn't only apply to AI-based items, but also to any other product. There's also the case of the poor seller who embellishes their product image using Photoshop or simply photography tricks.
For this, there's already a way to file a complaint on the Marketplace:
Flag this item > Reason for flag : Item Not As Advertised.
No need to create new rules.
Journey Bunny
Like it, but the problems are insurmountable.
- It is not possible to prove AI is used.
- Poor understanding of when AI is used, combined with the above inability to definitively price use. For example Photogrammetry is not generative AI; it is often mistaken for genAI now.
- If the concern is that an AI image does not represent the product, them there is a report type for "item not as advertised."
We may feel a repulsion to AI used in advertising, but a dislike for another's work is not a justification to ban it (and I acknowledge that this request does not suggest we should do that)-- the use of AI to misrepresent a product is something we should stop, but already can stop.
The existing protection is stronger. If a misrepresentation is made, report it.
Any new measure that would task LL with determining if AI was used and the percentage of AI use would weaken the premise, that no false advertising should be allowed.
If we are concerned that LL doesn't do enough with the existing report category, then adding a new one with even more difficult-to-assess terms will not address the concern.
Spidey Linden
Merged in a post:
Add Gen Ai in the do not show
Jesse Urvilan
I think we, as consumers, should have the right not to see generative AI content. We could even have a team, or consumers help report it, so you can determine if it’s generated by AI. I know this is probably similar to other feature requests, but how hard would it be to add a button to improve the marketplace experience? Right now, all these fake products are cluttering it, forcing us to see them. We all care about the community, and it’s time to listen to the people who use this platform. Thank you.
Dragon Hijinks
We need this or a way to block specific stores from showing up for us. I am so sick of having to trudge through this slop to get to actual decent items. I like browsing some categories by Newest, window shopping, but the flood of AI stuff is ruining that little hobby for me. :C
Jaydoge Resident
Yes to this, please and thank you!
Era Mercury
I 100% support this and any other measure that will allow us to make informed decisions on whether or not we support a store/"creator" that utilizes AI!
Rathgrith027 Resident
I support this measure.
VanessaChristy Resident
100% if it's gonna be a plague, at least give us a vaccine!
Load More
→