The status of the refugees will be a point of contention when President Trump meets the leader of South Africa at the White House on Wednesday.