Hosts South Africa were knocked out of the African Nations Cup when they lost a penalty shootout 3-1 to Mali after their quarter-final ended in a 1-1 draw after extra time today.