A great tutorial provided by @iamtrask. It teaches back propagation using a very simple toy example written in Python. You can follow the lessons here.