Paula Abdul & Nicole Scherzinger Won't Be Back on The X Factor

What's even more dramatic than frontrunner Rachel Crow collapsing into sobs after a shocking elimination from The X Factor?

The shakeup that's shaping up for season 2 of the Fox singing competition.

On the heels of the news that Steve Jones was leaving the show as host, judge Nicole Scherzinger is out as well, according to EW.com. And Paula Abdul was also let go from the show, a source confirms to PEOPLE.

Abdul had a tough time mentoring the groups, becoming the first judge without contestants on season 1. And Scherzinger faced serious backlash after Crow's elimination.

With the women off the judges' panel, record producer L.A. Reid and Simon Cowell, who is also the executive producer of the talent competition, are the only familiar faces that remain. There is no word yet on their replacements.

Paula Abdul and VJBrendan