Image Search inside another Image

Image Search inside another Image

I want to find similar images for a given image file.

For example:
Images 1,2,3,4 are similar.
Images 4,5,6,7 are similar. 3 may be similar with those.
I have tested http://www.phash.org/demo/ . There are three algorithms it
is used: Radial,DCT, Marr/Mexican.
DCT suggests 1-2 as similar. But it doesn't find 1-4 as similar.
Can you suggest different libs, algorithms especially to find 1-4 as
similar? As I said before my aim is to find (1,2,3,4) as similar and
(4,5,6,7) as similar.