Don Geman and I developed this series of synthetic image recognition problems to assess the performance of machine-learning techniques for vision. They require to go beyond local descriptors and simple statistics of the image to be solved properly.
You can get the source code from the repository with
git clone http://fleuret.org/git/svrt/
And can have a look at a few examples from each problem by clicking on these links: