Simon has told producers he won't appear on the next series of the ITV1 talent show, as he plans to focus his efforts on launching a US version of it.
Robbie initially indicated that they were interested in this job, but consider this matter seriously, finally decided against it after Sunday Mirror reported.
A friend of the singer said: 'The thing about Robbie these days is he doesn't enjoy the attention which comes with a showbiz lifestyle. He turns down so many public appearances - stuff worth millions every year. He just doesn't need it.
'X Factor lasts for three months and that's too lengthy a commitment.'
This year's series to make up a secret panel to decide if Cheryl Cole and Dannii U.S. show wisdom and Louis Walsh have still to offer contract will include Simon waiting to find live.
