The second interview, first reported by the Plain Dealer, came eight days after the first meeting between Whisenhunt and the Browns, who have been searching for a new coach since firing Pat Shurmur on Dec. 31.
Whisenhunt, 50, was fired by the Cardinals after a disappointing 5-11 season. Despite winning its first four games, Arizona stumbled to a last-place finish in the NFC West and its second losing season in the past three years.
Whisenhunt went 45-51 in six years with the Cardinals and led the franchise to its only Super Bowl appearance following the 2008 season.
Browns owner Jimmy Haslam and CEO Joe Banner are in Week 2 of their search to find a "strong leader" to take over the Browns, who also went 5-11 this season.
The Browns interviewed Carolina offensive coordinator Rob Chudzinski on Wednesday, league sources confirmed to Schefter, and also reportedly met with Marc Trestman, coach of the CFL's Montreal Alouettes, on Tuesday.
After meeting with Chudzinski, the Browns were expected to interview Indianapolis offensive coordinator Bruce Arians. The Colts have granted the Browns permission to speak with Arians, who has been hospitalized twice in recent days with an inner-ear infection.
Fox Sports reported the team will interview Cincinnati defensive coordinator Mike Zimmer, the first known defensive coach to meet with the Browns.
The Browns met late last week with Chip Kelly but decided to reboot their search for a coach after leaving Arizona late Sunday morning without landing the Oregon coach.
Information from The Associated Press was used in this report.