The team announced Tuesday that it had fired Caldwell, the second major decision in what is expected to be a long offseason shake-up. Colts owner Jim Irsay fired vice chairman Bill Polian and his son, general manager Chris, one day after the team finished a 2-14 season in which Manning didn't play because of neck surgery.
Instant Debate: End of an era?
"This was a difficult decision," Colts owner Jim Irsay said during a Tuesday news conference. "It was based on the feeling that this was a direction the franchise needed to go. I wanted to make sure we took all the time we needed to make sure it was the right decision."
"Everything I've heard is he's perfectly happy doing what he's doing," La Canfora said of Dungy, who has been working for NBC's "Football Night in America" since leaving the coaching ranks. "There's really been no smoke there for a couple of years now. He's been pretty equivocal with his stance on this."
Newly hired general manager Ryan Grigson said the Colts will be patient during their search for a coach.
"We don't want to do anything rash in any regard with any of this," Grigson said. "These are big decisions, and we don't want to be hurried."
Grigson said Caldwell was informed Tuesday of the team's decision to move in another direction.
The Associated Press contributed to this report.