GAN (Generate Almost Nothing when you don't know what you are doing)

2021-02-10

GANs are pretty cool, right? Yeah, they are unless you don't know what you are doing and this is where I come in. I had a hard time creating something that could actually create something other than random black and white dots on the screen. I just overestimated myself and underestimated GANs, I was a fool. I fooled myself into believing that they were 'just 2 models fighting against each other' which it was until it wasn't. My first mistake was understanding GANs in the 'same network but 2' way. They are two networks no doubt but they are so sensitive to small things changes. My second mistake was trying to be fancy, which not only made increased my training time but also made the images look worse. I think this was because my images are really simple, they are just black and white numbers (MNIST), I might be wrong don't quote me on that (please). So yeah what I should have done was to use parameters that actually work and keep it simple, making it complex isn't always better, and also I should have seen some videos on youtube on creating GANs.

Google colab is the best thing I found this year, seriously. The resources it provides and the thing we can do there, the best part is that it's free. I can do anything there and google will just let me do it. GANs require a lot of computation, if I had used my laptop to train GAN I would have fried my laptop's CPU in about 8 minutes (I haven't tested that but I am pretty confident). So yeah I owe google everything this time as well. You can see the generator generating images here . I haven't added this gif here in this blog because it's quite distracting and it kinda hurts your eyes. It's cool when you see it the first few times and then it starts being irritating and you want it to stop changing. Also, I don't think I will upload the implementation on Github as there are billion other better implementation of GAN on Github on top of that they are readable too, however if you want I did you can email me at arogyadahal20@gmail.com.