Page 66 of 75

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 12:58 pm
by MasonFace
That's really impressive, but I think it only works for videos, not still images.

Although it could probably be used for the intro video. My original upscale of that could use some improvement. Unfortunately, I doubt I'll have time to fool with it though...

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 1:53 pm
by DigitalMonk
I'm pretty sure you're right about "only videos". Especially with the discussion of the wavelet flows that originally needed motion vectors, but now can work with just video (which implies that the motion vectors are being calculated from the video). If you can accurately track how the camera is panning over a scene, you can extract a huge amount of additional information from image sequences. Older super-resolution used to work purely by this temporal alignment/stacking process. If you feed all of that information into a super resolution learning system, you get these amazing results. But it doesn't look like anything new on the single image front, unfortunately.

Still, damned impressive. Thanks for the link!

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 1:56 pm
by Ralzar
MasonFace wrote: Tue Sep 08, 2020 12:58 pm That's really impressive, but I think it only works for videos, not still images.
Make a film of all the sprites, run it through that program, then pick out frames and convert them into new sprites :D

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 3:43 pm
by MasonFace
Ralzar wrote: Tue Sep 08, 2020 1:56 pm Make a film of all the sprites, run it through that program, then pick out frames and convert them into new sprites :D
That would be spooky as hell if that actually worked. :lol:

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 6:18 pm
by MrFlibble
I just tried a recent model called Rebout Blend (available here), which is specifically made for character sprites, and it gives quite decent results with small flats -- notably better than previous models:
Image
It does a very good job with medium flats too (open image in separate window to enlarge):
Image

Re: AI Upscaled Textures

Posted: Tue Sep 08, 2020 6:26 pm
by MasonFace
Oh wow! That really is the best results by far on the small sprites.

Re: AI Upscaled Textures

Posted: Thu Sep 10, 2020 10:32 am
by King of Worms
Nice job on the artifacts upscales MasonFace, thanks a lot :)
Also, this new ReboutBlend algo indeed looks really good!

Re: AI Upscaled Textures

Posted: Mon Sep 14, 2020 7:50 pm
by MrFlibble
I just tried a different model by LyonHrt called Lollypop that gets some good result on textures, and interesting results on sprites, and then decided to interpolate it with Rebout Blend (alpha = 0.3), and got some pretty nice results with the sprites (definitely better than from using either Lollypop or Rebout Blend alone):
Image
Image
Image
Image
Image
Image
Here's the net_interp code:

Code: Select all

net_PSNR_path = './models/lollypop.pth'
net_ESRGAN_path = './models/reboutblend.pth'

Re: AI Upscaled Textures

Posted: Tue Sep 15, 2020 9:43 am
by MrFlibble
I ran some further tests with Lollypop and the interpolated model on larger pre-rendered sprites, I think Lollypop alone (images on the left side) does good job but the other is fine too.
Image Image
Image Image
Image Image
Image Image
Image Image
Image Image

Re: AI Upscaled Textures

Posted: Fri Oct 09, 2020 1:08 pm
by MrFlibble
I've been playing more with ESRGAN models lately and found one called Fatality MKII (available here) which does this to villager close-up faces:
Image Image