Question: Stable Defusion to recreate game assets using sprites as Image to Image guideance.

[TazzTheFox]

I'm new to modding for Daggerfall Unity and want to use Stable Diffusion to create modernized versions of some in-game assets. I’ve started by generating new versions of the Wereboar and Werewolf sprites using Image-to-Image Stable Diffusion (kind of a proof of concept), using the original sprites as a guideline—these aren’t simple AI upscales like some other mods will do. Obviously will use photoshop to touch these up at a later date if I am able to even figure out how to get these in game.

I have Unity installed and set up with Daggerfall Unity, but I'm not sure what steps to take next. Any help or guidance would be greatly appreciated! For the record these two images took like 10 minutes to do and it is possible to do this in bulk.

[Jehuty]

I have moved this topic to Modder Discussion.

[MrFlibble]

I'm more of an AI sceptic at this point, but the images look pretty good and rather authentic to the low-res originals.

I'd recommend to crop the UI frame though and just leave the character sprites and the background.

Can you show what your AI can do with human character images? Just remember though, there are hundreds of clothing and armour items for PC paperdolls, and while the AI might produce a good image of the composite result, you will need to do a lot of uniform cropping for the new paperdolls to actually work in-game.

[King of Worms]

Looks good.

You get this ingame by placing the files in "...DaggerfallUnity_Data\StreamingAssets\Textures\IMG"

correct naming is
BOAR00I0.IMG.png
WOLF00I0.IMG.png

[TazzTheFox]

I'm more of an AI sceptic at this point, but the images look pretty good and rather authentic to the low-res originals.

I'd recommend to crop the UI frame though and just leave the character sprites and the background.

Can you show what your AI can do with human character images? Just remember though, there are hundreds of clothing and armour items for PC paperdolls, and while the AI might produce a good image of the composite result, you will need to do a lot of uniform cropping for the new paperdolls to actually work in-game.

This was to be expected and With Impaint and Photoshop I think it can be possible to make authentic looking paper dolls and backdrops. Yes it's a lot of work for the amount of flat assets that exist but Im pretty confident that anything can be replicated using Stable Diffusion.

I will give more examples in the near future.

Looks good.

You get this ingame by placing the files in "...DaggerfallUnity_Data\StreamingAssets\Textures\IMG"

correct naming is
BOAR00I0.IMG.png
WOLF00I0.IMG.png

Thank you!