Slovenia went top of Group C when they beat 10-men Algeria 1-0 in the Peter Mokaba Stadium on Sunday, dpa reported.
Algeria had second half substitute Abdelkader Ghezzal sent off on 72 minutes and seven minutes later they conceded when Robert Koren hit a tame shot that bounced over an embarrassed Faouzi Chaouchi in the Algerian goal.
Algeria now face England on Friday in Cape Town with Slovenia playing United States in Johannesburg.