#generated ai

[ottopilot-ai]

Anatomy of a Scene: Photobashing in ControlNet for Visual Storytelling and Image Composition

This is a cross-posting of an article I published on Civitai.

Initially, the entire purpose for me to learn generative AI via Stable Diffusion was to create reproducible, royalty-free images for stories without worrying about reputation harm or consent (turns out not everyone wants their likeness associated with fetish smut!).

In the beginning, it was me just hacking through prompting iterations with a shotgun approach, and hoping to get lucky.

I did start the Pygmalion project and the Coven story in 2023 before I got banned (deservedly) for a ToS violation on an old post. Lost all my work without a proper backup, and was too upset to work on it for a while.

I did eventually put in work on planning and doing it, if not right, better this time. Was still having some issues with things like consistent settings and clothing. I could try to train LoRas for that, but seemed like a lot of work and there's really still no guarantees. The other issue is the action-oriented images I wanted were a nightmare to prompt for in 1.5.

I have always looked at ControlNet as frankly, a bit like cheating, but I decided to go to Google University and see what people were doing with image composition. I stumbled on this very interesting video and while that's not exactly what I was looking to do, it got me thinking.

You need to download the controlnet model you want, I use softedge like in the video. It goes in extensions/sd-webui-controlnet/models.

I got a little obsessed with Lily and Jamie's apartment because so much of the first chapter takes place there. Hopefully, you will not go back and look at the images side-by-side, because you will realize none of the interior matches at all. But the layout and the spacing work - because the apartment scenes are all based on an actual apartment.

The first thing I did was look at real estate listings in the area where I wanted my fictional university set. I picked Cambridge, Massachusetts.

I didn't want that mattress in my shot, where I wanted Lily by the window during the thunderstorm. So I cropped it, keeping a 16:9 aspect ratio.

You take your reference photo and put it in txt2img Controlnet. Choose softedge control type, and generate the preview. Check other preprocessors for more or less detail. Save the preview image.

Lily/Priya isn't real, and this isn't an especially difficult pose that SD1.5 has trouble drawing. So I generated a standard portrait-oriented image of her in the teal dress, standing looking over her shoulder.

I also get the softedge frame for this image.

I opened up both black-and-white images in Photoshop and erased any details I didn't want for each. You can also draw some in if you like. I pasted Lily in front of the window and tried to eyeball the perspective to not make her like tiny or like a giant. I used her to block the lamp sconces and erased the scenery, so the AI will draw everything outside.

Take your preview and put it back in Controlnet as the source. Click Enable, change preprocessor to None and choose the downloaded model.

You can choose to interrogate the reference pic in a tagger, or just write a prompt.

Notice I photoshopped out the trees and landscape and the lamp in the corner and let the AI totally draw the outside.

This is pretty sweet, I think. But then I generated a later scene, and realized this didn't make any sense from a continuity perspective. This is supposed to be a sleepy college community, not Metropolis. So I redid this, putting BACK the trees and buildings on just the bottom window panes. The entire point was to have more consistent settings and backgrounds.

Here I am putting the trees and more modest skyline back on the generated image in Photoshop. Then i'm going to repeat the steps above to get a new softedge map.

I used a much more detailed preprocessor this time.

Now here is a more modest, college town skyline. I believe with this one I used img2img on the "city skyline" image.

[victusinveritas]

[unforth]

Y'all I know that when so-called AI generates ridiculous results it's hilarious and I find it as funny as the next guy but I NEED y'all to remember that every single time an AI answer is generated it uses 5x as much energy as a conventional websearch and burns through 10 ml of water. FOR EVERY ANSWER. Each big llm is equal to 300,000 kiligrams of carbon dioxide emissions.

LLMs are killing the environment, and when we generate answers for the lolz we're still contributing to it.

Stop using it. Stop using it for a.n.y.t.h.i.n.g. We need to kill it.

Sources:

[animentality]

[iapislazuli]

idk what traumatized or mentally ill person needs to hear this but dreams (especially the really disturbing ones you dont want to talk about to anybody) arent some deep peek into your psyche or a sign of your True Desires or whatever theyre quite literally your brain making fruit salad with whatever it can find on the shelf. just putting all that shit in a blender and hitting obliterate. its fine, youre fine, youre not a weirdo for it

[memendoemori]

Good morning everybody

[dragoncarrion]

Fucking hate ai bitches this shit is poisoning my search results just like that tumblr baby crow post fuck y'all for real

[female-ai-heaven]

[developmentinformationday]

Launch of the ILO Observatory on AI and Work in the Digital Economy.

The ILO Observatory on AI and Work in the Digital Economy aims to be the leading international knowledge hub on the world-of-work dimensions of artificial intelligence (AI) and the digital economy, serving as a platform for increasing the volume and profile of evidence, analysis and dialogue in these areas.

Watch the Launch of the ILO Observatory on AI and Work in the Digital Economy!

[prokopetz]

It's true that there's no practicable way to frame "style theft" as an intellectual property issue that wouldn't have horrifying consequences for independent artist, but that doesn't mean we can't have sympathy for all the artists who've spent their lives perfecting the craft of drawing moist-lipped, glassy-eyed, vaguely oily-looking anime girls in three-quarter profile and now everybody thinks they're a robot.

[victusinveritas]

[mindsynthcreations]

[animentality]

[troythecatfish]

[sarahdraws16]

Fuck Meta