Excellent set of tips George Seif.
I can personally vow for using over sampling when dealing with an unbalanced data set — remember to use a random crop though, otherwise the model will overfit quickly.
I’m keen to try out the switching of optimizer in a project I’m currently working on — will hopefully have good feedback.
Keep up the good work!
Source: Deep Learning on Medium