Using DALL-E 2 for Interior Design

With advancements in AI-generated images happening so quickly these days, this post will probably be outdated the moment it’s published. But I figured it could be good to document some experiments with DALL-E 2 and interior design while it still feels fresh.

DALL-E 2, if you don’t know, is a new text-to-image generation model that is revolutionizing digital visual media. DALL-E 2 and other similar models (like Stable Diffusion and Imagen) work the same way; they were shown millions of images from across the web and have learned what things are called and what they look like, and so can generate images of basically anything you request.

(If you’re interested in generating images from scratch, this DALL-E 2 Prompt Book is an amazing guide.)

Although it’s amazing to create images from nothing, I’m more interested in using this technology to augment existing images. This is sometimes called “inpainting” and it’s a powerful way to focus the magic of AI-generated images into real-life images that have significance to you.

For example, I wanted to see how I could use AI to add some design flair to a newly-purchased cabinet in my dining room, so I uploaded this image to DALL-E 2 and got started.

A yellow waist-high cabinet on a wood-paneled wall.
The starting point – let’s add some flair to this cabinet…

DALL-E 2 has an interface that lets you define which areas to augment, so I hastily defined an area I wanted to decorate.

A screenshot of the dall-e 2 interface showing the same cabinet image above, but with a hand-drawn transparent area covering the countertop and background wall.
Defining the areas where the AI can play

From there, you can start typing and describing what you want in your image. With inpainting, only the parts of the image you define will be augmented; the rest will be unchanged.

To start experimenting, I typed “various decorative items”.

A screenshot of the dall-e 2 interface showing the prompt "various decorative items". It shows the original cabinet image, and 3 variations; each containing small strange objects placed on the cabinet.
“various decorative items”

Some results were better than others. But there’s potential. Next I thought to try something a little broader.

A screenshot of the dall-e 2 interface showing the prompt "chic home decor". It shows the original cabinet image, and 3 variations; one of them has absolutely nothing on the cabinet, 1 has a small potted plant, and 1 has two strange small sculpture-like items.
“chic home decor”

Still not much luck. So then I started getting more specific and things started looking better.

A screenshot of the dall-e 2 interface showing the prompt "chic vase". It shows the original cabinet image, and 3 variations; each contains a modern chic-looking vase with a plant.
“chic vase”

Descriptive words like “chic” definitely help, because when I tried just “vase” the results were definitely uninspired.

A screenshot of the dall-e 2 interface showing the prompt "vase". It shows the original cabinet image, and 3 variations; all with a single plain potted plant sitting on the cabinet.
“vase” – not too exciting

Next I tried some more descriptive stylistic phrases and it seemed to help.

A screenshot of the dall-e 2 interface showing the prompt "chic vase, mid-century modern". It shows the original cabinet image, and 3 variations; 1 with a medium-sized clay vase with a spikey angular plant, 1 with a large green glass vase, and 1 with two bulbous green glass vases.
“chic vase, mid-century modern”

I realized I was going to need to specifically define which objects to include in the scene, so I opted to add a picture frame and a plant. After some experimentation and variations, things were starting to look pretty good…

A screenshot of the dall-e 2 interface showing the prompt "chic vase, picture frame, mid-century modern". It shows the original cabinet image, and 3 variations; 1 with a photo with a thick black frame and white matte, 1 with a small red decorative sculpture and picture frame, and 1 with a small green vase and picture frame of a floral image.
“chic vase, picture frame, mid-century modern”
A screenshot of the dall-e 2 interface showing the prompt "decorative vases, a framed photo with gold frame, a plant". It shows the original cabinet image, and 3 variations; 1 with a white vase and an overflowing plant, 1 with a black photo frame with a pink medium-vase with a bushy plant, and 1 with 3 small decorative vases and a larger golden circular vase with a large spikey plant.
“decorative vases, a framed-photo with gold frame, a plant”
A screenshot of the dall-e 2 interface showing the prompt "decorative vases, a framed photo with gold frame, a plant". It shows the original cabinet image, and 3 variations; 1 with a potted plant and two small photo fames, 1 with two larger photo frames and small potted plant, and 1 with a small framed photo, a small circular vase, and strange looking coat rack on the wall.
“decorative vases, a framed-photo with gold frame, a plant”
A screenshot of the dall-e 2 interface showing the prompt "decorative vases, a framed photo with gold frame, a plant". It shows the original cabinet image, and 3 variations; 1 with 3 potted plants and a medium-sized framed photo, 1 with a medium-sized framed photo and small potted plant, and 1 with a large framed photo of a play and a small potted plant.
“decorative vases, a framed-photo with gold frame, a plant”
A screenshot of the dall-e 2 interface showing the prompt "decorative vases, a framed photo with gold frame, a plant". It shows the original cabinet image, and 3 variations; 1 with a large and small potted plant, 1 with a large black-framed photo next to a large purple metallic vase, and 1 with a medium gold-framed photo and potted plant in a medium black vase.
“decorative vases, a framed-photo with gold frame, a plant”

After I found a list of objects that were working well, I just kept refreshing the same prompt and finding images that I liked…

An enlarged photo of the original cabinet showing ai-generated items on its surface; a picture frame, decorative object, and golden lamp.
“decorative vases, a framed photo with a gold frame, a stylish lamp. chic decor.”
An enlarged photo of the original cabinet showing ai-generated items on its surface; two picture frames, and a white lamp with black lampshade.
“decorative vases, a framed photo with a gold frame, a stylish lamp. chic decor.”
An enlarged photo of the original cabinet showing ai-generated items on its surface; a picture frame and two large shiny pink vases.
“decorative vases, a framed photo with a gold frame, a stylish lamp. chic decor.”
An enlarged photo of the original cabinet showing ai-generated items on its surface; two picture frames and two sculptural items that look like candlesticks.
“decorative vases, a framed photo with a gold frame, a stylish lamp. chic decor.”
An enlarged photo of the original cabinet showing ai-generated items on its surface; one large picture with a gold frame, one gold decorative object, and one black vase.
“decorative vases, a framed photo with a gold frame, a stylish lamp. chic decor.”

So after a bunch of experimentation and learning what I liked and what I didn’t, I was finally ready to make a journey to Home Goods and purchase some stuff. Here’s how it turned out:

A different photo of the original cabinet, but with actual decorative items on its surface. (Not ai-generated.) On the surface is a decorative green vase, a decorative blue bowl, a medium-sized picture with a gold frame, and a gold teardrop-shaped lamp with a dark blue shade.
The big reveal! Real-life purchases inspired by AI.

So that’s my first foray into using AI to augment the interior design process. The end result isn’t particularly breathtaking stylistically, but I found that the process of seeing a bunch of options to help define my preferences was really helpful – and kinda fun too.

(Here’s a business idea for you: A Tinder-style app for decorating your space. Upload a photo of the area you want to decorate, then swipe right/left on AI-generated images of decor options as the app learns your style preferences. Then it’ll generate affiliate links to similar products on Amazon, and you’re golden.)

Overall this process was relatively inexpensive – DALL-E 2 charges $15 for 115 credits, and each credit produces 3 images. That works out to just over $0.04 per image. I used about 100 credits during these experiments, that’s around $13 to figure out how to furnish this part of my home. Not bad compared with interior designers who charge hundreds of dollars per hour. And this stuff will only get cheaper with time, especially with Stable Diffusion recently open-sourcing their model.

If this is what one random dude can achieve with this technology, I’d love to see what an actual interior-decor specialist can achieve.

Special thanks to the phenomenal Marcha Johnson (LinkedIn, Instagram) for arranging access to DALL-E 2!