Judges are the only ones with X Factor on the first show