AI Upscaled Textures

Show off your mod creations or just a work in progress.
Post Reply
User avatar
MasonFace
Posts: 543
Joined: Tue Nov 27, 2018 7:28 pm
Location: Tennessee, USA
Contact:

Re: AI Upscaled Textures

Post by MasonFace »

Ah, then the XML file would work perfectly!

Edit: I made a request for you in the DREAM thread, but I thought I'd put it here too for greater visibility. Would it be possible to add modder access to the number of animation frames using an XML file? If this can't be done easily, then it can definitely wait! No rush! :)

User avatar
MrFlibble
Posts: 411
Joined: Sat Jan 27, 2018 10:43 am

Re: AI Upscaled Textures

Post by MrFlibble »

Azteca wrote: Sun Apr 21, 2019 7:38 pm Hey folks, though you clearly have some very advanced and specific workflows, I thought I would share this tool.
GUI for ESRGAN with waifu2x prefiltering and model blending.
We have some experts on these forums by now, but it might be a good way for the less technical to dip their toes in.
That's very interesting, thanks for sharing!
MasonFace wrote: Mon Apr 22, 2019 12:12 am Thank you for sharing this! I'm glad someone finally took the effort to compile a GUI for all that stuff. It would be really interesting to see MrFlibble's pre-processing methods (and maybe even a noise generator too) incorporated into this program.
Agreed, at least it would be nice to know what other people think of them. (But the tool like this would also help optimise the tedious multipass pre-processing routine).

@King of Worms, since you're already registered at that forum, would you mind telling the satsuki about the xBRZ preprocessing method. I just threw together a small comparison with the same sprite from DF scaled up using one, two and three passes:
https://imgur.com/a/foJnH31
(it also seems that three xBRZ passes are actually better than one xBR plus two xBRZ passes)

The description of the process is here, I also think that you can use Bicubic for scaling down instead of Sinc if Gaussian blur is applied at 1.5 pixel radius (i.e. Gaussian @ 1 + Sinc = Gaussian @ 1.5 + Bicubic).

But that's not all! While I did not intend to use the ESRganResizer tool, I noticed that the screenshot mentioned a model I was not aware of, so I downloaded it to check out what's inside. Two new models, so I decided to Google for more and found this:
https://esrgan.blogspot.com/2019/01/blog-post.html
Someone took the trouble of training a lot of models intended to upscale 8-bit video game graphics (although none of them were trained on data sets made from video game graphics). The results are rather impressive -- the cartoonpainted model for example can decently handle sprite edges without any preprocessing at all (still not perfect though):
Image
cartoonpainted_80000

Image
cartoonpainted_5000

The 80000 actually produced very decent faces for the NPCs -- looking much better than anything we got with Manga109 or its interpolations.

UPD: I interpolated cartoonpainted_80000 with PSNR at alpha 0.8 and ran some of the test sprites through it with a single xBRZ pass and no prior sharpening (original image - scale w/ xBRZ -> Gaussian blur 1 pixel radius -> scale down to original size with Sinc). Results:
https://imgur.com/a/WH1AFpM

User avatar
King of Worms
Posts: 4752
Joined: Mon Oct 17, 2016 11:18 pm
Location: Scourg Barrow (CZ)
Contact:

Re: AI Upscaled Textures

Post by King of Worms »

Ive linked this post to him, will take a while, because new posts need to be checked by admins...
PS: Awesome results in the screens!!!

User avatar
MasonFace
Posts: 543
Joined: Tue Nov 27, 2018 7:28 pm
Location: Tennessee, USA
Contact:

Re: AI Upscaled Textures

Post by MasonFace »

Wow! I particularly like the cartoonpainted_80000 results.

satsuki_yatoshi
Posts: 28
Joined: Mon Apr 29, 2019 8:29 pm

Re: AI Upscaled Textures

Post by satsuki_yatoshi »

Hello i'm the dev of the ESrganResizer GUI.
As i can't integrate all the prefilters you'll need, i'll do a modification for the GUI :
Image
So you'll can:
-Use it as the curent GUI (you'll need to click on "write waifu prefilter commands" before starting the "Go").
-Make, save, load... you own prefilters commands, with temporary files if you use multi step prefilters.

It'll take me some time to do this so be patient, but i think that with this version you can easily use the prefilters you want.

User avatar
Azteca
Posts: 143
Joined: Tue Mar 26, 2019 12:38 am

Re: AI Upscaled Textures

Post by Azteca »

Wow, I am really pleased to see that the tool I shared is helping you all to do your work!

Great work, MrFlibble. I saw that blog post when it came out but never tested the models myself, so it was hard to judge how well they were working. I am really impressed with the results. I am surprised how close it is to the hand-painted hi-res sprites (minus the faces, of course).

Welcome, satsuki_yatoshi! Thank you for speaking to our community and addressing our needs. Your tool is going to help a lot of people make great textures.

User avatar
King of Worms
Posts: 4752
Joined: Mon Oct 17, 2016 11:18 pm
Location: Scourg Barrow (CZ)
Contact:

Re: AI Upscaled Textures

Post by King of Worms »

Hi Satsuki, thanks for responding to my post on Qhimm (HybOj) and getting back to us!

Your tool is great but It does not work for me, I just get a unexpected error tab (after all things are installed, cuda, all pre-requisities, python scripts are executed etc)

Can there be some LOG file system implemented so we can see what is going on - the "unexpected error" is so vague I have no clue what is wrong.
Is GTX 970 enough for this to work?

Thank you.

PS: IS someone here using this tool successfully on Windows 7 x64?

satsuki_yatoshi
Posts: 28
Joined: Mon Apr 29, 2019 8:29 pm

Re: AI Upscaled Textures

Post by satsuki_yatoshi »

Could you give me the full output command ? (if needed i can add an option "output as log instead of command" so you can have trhe full command output as a log)
Have you tried the without cuda option ?

User avatar
King of Worms
Posts: 4752
Joined: Mon Oct 17, 2016 11:18 pm
Location: Scourg Barrow (CZ)
Contact:

Re: AI Upscaled Textures

Post by King of Worms »

Hi, I will install it once more and make a screenshot of the output command. It would be cool to have it in a txt format but I think it will not be necessary now.

I do not know how to set it up to NOT use cuda?

PS: Downloading now, will install and reply in one hour

satsuki_yatoshi
Posts: 28
Joined: Mon Apr 29, 2019 8:29 pm

Re: AI Upscaled Textures

Post by satsuki_yatoshi »

With the "Go cpu" but the current version needs cuda for waifu too, that's why i'll add a "cpu mode" to waifu in next release

Post Reply