The singer, who was slated to perform on the late night talk show to kick off his already-postponed tour, released a statement on Monday saying he "cannot morally be on a television program where the cast members of Duck Dynasty will also be guests."
The statement continued: "Morrissey would be honored to play the show, if 'Duck Dynasty' were removed."
The A&E reality program focuses on a family that became wealthy by making duck-call tools for duck hunters. The former Smiths frontman is a staunch animal rights activist.
E Online reports that Morrisey also stated:
"As far as my reputation is concerned, I can't take the risk of being on a show alongside people who, in effect, amount to animal serial killers. If Jimmy cannot dump Duck Dynasty, then we must step away."
According to the Associated Press, a source close to Kimmel said the singer's performance would be rescheduled.
Morrissey has been in the headlines this month for hosting the first all-vegetarian concert at the Staples Center in Los Angeles.