Djokovic, who didn't drop a set through his first four matches of the tournament, faced his first challenge in the No.