Question: Stable Defusion to recreate game assets using sprites as Image to Image guideance.

[TazzTheFox]

I'm new to modding for Daggerfall Unity and want to use Stable Diffusion to create modernized versions of some in-game assets. I’ve started by generating new versions of the Wereboar and Werewolf sprites using Image-to-Image Stable Diffusion (kind of a proof of concept), using the original sprites as a guideline—these aren’t simple AI upscales like some other mods will do. Obviously will use photoshop to touch these up at a later date if I am able to even figure out how to get these in game.

I have Unity installed and set up with Daggerfall Unity, but I'm not sure what steps to take next. Any help or guidance would be greatly appreciated! For the record these two images took like 10 minutes to do and it is possible to do this in bulk.

[Jehuty]

I have moved this topic to Modder Discussion.

[MrFlibble]

I'm more of an AI sceptic at this point, but the images look pretty good and rather authentic to the low-res originals.

I'd recommend to crop the UI frame though and just leave the character sprites and the background.

Can you show what your AI can do with human character images? Just remember though, there are hundreds of clothing and armour items for PC paperdolls, and while the AI might produce a good image of the composite result, you will need to do a lot of uniform cropping for the new paperdolls to actually work in-game.