Superpaint

Inspiration

Inspired by stable diffusion prompt workflows on reddit and photoshop plugins that do the same.

What it does

It's a drawing app which is assisted by AI.

How we built it

• Stable Diffusion img2img and inpaint/outpaint models via Replicate.com
• fabricjs for canvas
• React + nextjs for API

Challenges we ran into

Finding a good UX for all these utilities.

Accomplishments that we're proud of

Inpainting and outpainting were tricky UX wise.

What we learned

Using the right models and prompts is what determines success. Hence we provided a minimal prompt maker (with predefined styles)

What's next for Superpaint

• iPad wrapper app
• Use offline Stable Diffusion to run locally on M1 iPads
• Port a version that is specific for game art, for Playroom; an SDK for making party games (https://joinplayroom.com)

Built With

• fabric.js
• react
• replicate
• stablediffusion