AI Upscaled Textures

Show off your mod creations or just a work in progress.
User avatar
King of Worms
Posts: 2196
Joined: Mon Oct 17, 2016 11:18 pm
Location: Scourg Barrow (CZ)
Contact:

Re: AI Upscaled Textures

Post by King of Worms » Sun Aug 25, 2019 8:56 am

Upscaling daggerfall videos would be so cool!

What we have now is:
ANIM0000 - thats a complete remake of a Intro video by Rhymer (the one with a book) - its very good but the sound is quite bad :/
ANIM0001 - Bethesda logo by Rhymer, with additional DFU workshop part, great quality
DAG2 - above mentioned video by MasonFace, plus Pango remastered the sound, great quality as well

phredreeke
Posts: 53
Joined: Mon Mar 11, 2019 9:13 am

Re: AI Upscaled Textures

Post by phredreeke » Sun Aug 25, 2019 2:01 pm

how long are the videos?

there is an ESRGAN model specifically trained for dedithering https://upscale.wiki/wiki/Model_Database#Dithering

I used the box model on the same page to upscale the DNF trailer. then I used a very complicated avisynth script which repositions neighbouring frames and blends them together. also had to do some repairs (video dropouts, the best source available is from a promotion DVD, there's a bunch of interesting things about it but I'll save that for some other time)

Edit: here's an upscaled frame https://i.imgur.com/olvlNGc.png

Firebrand
Posts: 155
Joined: Thu Jul 18, 2019 6:07 pm

Re: AI Upscaled Textures

Post by Firebrand » Sun Aug 25, 2019 3:13 pm

speaking of videos (well, sort of :? ) I was wondering about Daedric Princes summons...

Image

how they are implemented in game? It could be possible to upscale them, and maybe increase the framerate? :?

User avatar
MasonFace
Posts: 334
Joined: Tue Nov 27, 2018 7:28 pm
Contact:

Re: AI Upscaled Textures

Post by MasonFace » Sun Aug 25, 2019 3:14 pm

Pango was kind enough to post some summary information about the videos in our discussion about remaking/upscaling the videos here: viewtopic.php?f=14&t=1155&hilit=on+intr ... =20#p21739

The lengths of the videos aren't shown, but they are all fairly short, roughly 15 seconds long or less if I remember correctly.

There was also discussion in that thread about where to find the VID files in the game directory and how to read them.

phredreeke
Posts: 53
Joined: Mon Mar 11, 2019 9:13 am

Re: AI Upscaled Textures

Post by phredreeke » Sun Aug 25, 2019 4:32 pm

I processed ANIM0002-0005 and 0012-0013

https://www.dropbox.com/s/hpitsz0zi53ii ... e.ogv?dl=0

Results are kinda mixed + I forgot to correct aspect ratio. Also I didn't know what frame rate they're supposed to play at.

User avatar
King of Worms
Posts: 2196
Joined: Mon Oct 17, 2016 11:18 pm
Location: Scourg Barrow (CZ)
Contact:

Re: AI Upscaled Textures

Post by King of Worms » Sun Aug 25, 2019 4:47 pm

phredreeke wrote:
Sun Aug 25, 2019 4:32 pm
I processed ANIM0002-0005 and 0012-0013

https://www.dropbox.com/s/hpitsz0zi53ii ... e.ogv?dl=0

Results are kinda mixed + I forgot to correct aspect ratio. Also I didn't know what frame rate they're supposed to play at.
Wow thats actually really good!! (no sound tho..)

Yes, there are few glitchy spots, like the raven head squeaking in a dead sequence, but Id say 90% of the vids are nice, and some are just extraordinary to me, like the lysandus coffin with the flying light. There are few stutters and some odd frames, but I guess thats because of the videos being merged to one file..

The properties of the current remade vids are:

anim0000 - 25fps - cca 4000kbps bitrate - 122kbps 40khz stereo - 1920*1080
anim0001 - 25fps - cca 3000kbps bitrate - 111kbps 44.1 stereo -- 1920*1080
dag2 - 30,01 fps -- cca 2000kbps bitrate -- 54kbps 44.1 mono -- - 1280*720

All are mp4 because ogv does not work in DFU

No idea about the aspect ratio.

Please do your magic, even if its not perfect, its really good compared to that 320*200 mess.
Would be so cool to have all the vids remastered. I can pack them in the DFMOD afterwards, ofc crediting you!

And maybe Pango can remaster the sound afterwards, the way he did dag2 which had perfect results

phredreeke
Posts: 53
Joined: Mon Mar 11, 2019 9:13 am

Re: AI Upscaled Textures

Post by phredreeke » Sun Aug 25, 2019 5:05 pm

I assumed a framerate of 15 fps for them all.

TBH I think for 2 and 4 it'd be better if I just posted the upscale of the unfaded frames and whoever has the artistic talent can touch them up and then remake the fades.

User avatar
MasonFace
Posts: 334
Joined: Tue Nov 27, 2018 7:28 pm
Contact:

Re: AI Upscaled Textures

Post by MasonFace » Sun Aug 25, 2019 5:09 pm

Outstanding results, Phredreke!

I think 2 and 4 look fantastic as you've done it, but I do understand what you mean about just upscaling the stills and having someone recreate the fade transitions...

I would like to package these into the PVE mod as well with your permission and credit!

I believe the originals were 14fps.

phredreeke
Posts: 53
Joined: Mon Mar 11, 2019 9:13 am

Re: AI Upscaled Textures

Post by phredreeke » Sun Aug 25, 2019 5:26 pm

I saw the framerates listed in the topic you linked to afterwards. They vary between video to video.

Edit: I've upscaled the different frames from anim0002 and 0004, as well as various illustrations in the books from 0006-0010 and 0014-0015 using a different model here https://files.fm/f/ubxaucyt

phredreeke
Posts: 53
Joined: Mon Mar 11, 2019 9:13 am

Re: AI Upscaled Textures

Post by phredreeke » Mon Aug 26, 2019 9:16 am

Here's a quick attempt I made at editing a couple of the different frames together for more detail in the long shots

https://imgsli.com/NTkyOQ

Post Reply