Artify

• 

  Face-1

• 

  Face-2

• 

  Sketch-1

• 

  Sketch-2

• 

  Face-3

Inspiration

In the day of Instagram, we are exposed to multiple people who draw such nice and creative comics. We were inspired by them and wanted to try our hands in making comics and we started with drawing the faces of the characters. But we failed xD. So, we went through research papers and searched for something that can help us to take baby steps in this area. And like this, Artify was born.

What it does

This tool can be used by anyone easily. It is interactive with a very simple GUI. How does it help users to draw. you ask? It automatically provides recommendations to the users with every stroke they draw. The users just have to have an idea in their mind as to what they want and they can just draw away. Imagination is your limit.

Those live recommendations are dynamic and allows users to explore multiple features or forms like what if my character had wavy hair or what if my character wears spectacles. Such changes can be easily experimented upon and get results as they desire.

After this, we explored some more possibilities of its usage. Some of them can be as follows -

1. Can be used by artists.
2. A modified version can be used by police or other law enforcement agencies to quickly draw the sketch.
3. Can be used by product designers to quickly explore possibilities of a certain design.

How we built it

It is based on interactive GAN sketch-to-image translation. We have trained the model and have provided the users with pre-trained weights. The users can train the model themselves as well. The user interface was inspired from iGAN and made using PyQt. More details regarding the research papers can be found in the GitHub repository. As the users edit the sketch which they have drawn, a feedback loop is created which provides corresponding colored completed images.

Challenges we ran into

The general GAN models are pretty big which makes them run in mostly offline modes. We wanted for our users to have the capability of running the program interactively hence making it a real time application and after applying some optimizations we were able to do so.

Accomplishments that we're proud of

The artistic effects produced from our model were very realistic. Also, we were able to draw our first comic character and hope that people can draw easily.

What we learned

We learned about GANs, their functionality and implementations. We also learnt various optimizations using Pytorch and it was of great help in implementing real time GAN models.

How to run it

• Clone the Artify repo: git clone https://github.com/yudhik11/Artify cd Artify pip install -r requirements.txt

What's next for Artify

For Artify, there are endless possibilities including usage in law-enforcement agencies, designing products, fast mock-up designing, etc. Added features like full body design, exporting the designs and making it more user friendly will be our top priority.

Built With

• art
• gan
• pyqt
• python
• pytorch
• sketch
• sketch-engine