Well, if we can do that, so should the programs be able to do that, right. Now how do you think such a program would work? Any ideas?
Danny's program does it with 85% accuracy BTW. The following Perl does it with 50% accuracy (on a sample with equal number of photos of males and females) ;)
perl -e 'print "Male\n";'