Expect some major changes when "The X Factor" returns this fall.

It was announced today that host Steve Jones, and judges Paula Abdul and Nicole Scherzinger will not be returning to the Fox reality talent show next season.

An insider told E! News, "Simon (Cowell) wants to take the show in a different direction."

This leaves Cowell and fellow judge L.A. Reid as the only remaining cast members from last season.