It appears that the outspoken "X Factor" TV-music judge and executive producer, Simon Cowell, doesn't really want to keep up with the Kardashians. Well, at least not Khloe Kardashian.

The New York Post reported that Kardashian will not be picked up for a follow-up season to her hosting debut for Season 2 of Fox Television's "X Factor."

"They are asking Mario [Lopez] to come back, but not Khloe," an anonymous inside source revealed Sunday (Feb. 17) to New York Post.

Fox had hoped that bringing in Kardashian would boost the ratings.

However, Fox execs have admitted publicly [the show]  has been a bit of a disappointment ratings-wise, according to Examiner, and if it was even possible, Kardashian's involvement saw an even further free fall--20 percent drop in viewership over its second season, according to New York Post.

L.A. hosting expert Marki Costello, whose credits include coaching Cee Lo Green on NBC's "The Voice," told the New York Post that a shows eventually have to make the decision: Is this person helping or hurting the series.

"It was really hard for me to watch Mario with her," she observed. "It made me, as a viewer, almost uncomfortable." 

The firing doesn't come as a shock, Kardashian herself admitted on Ryan Seacrest's (host of "American Idol" and producer of "Keeping Up With The Kardashians") radio show that she was afraid she would say something to get herself fired. She then told him that perhaps she could sit on executive producer Cowell's lap and convince him to keep her on, according to Examiner.

Even betting oddsmakers like Bovada.com placed odds on whether or not she would return for Season 3 (with the probability falling in favor of her not returning), stated Examiner.

The announcement of Kardashian's firing just adds to Cowell's headache, as, on top of searching for two new judges, due to L.A. Reid and Britney Spears leaving the show, according to Examiner, he now needs to find a new co-host or leave current host, Lopez, by his lonesome, once more.