The NFL announced the suspension Monday, stating that Goldson will serve the one-game ban during Sunday's game against the Detroit Lions.
On Tuesday the league upheld the suspension, league sources told ESPN senior NFL analyst Chris Mortensen. The ban will cost Goldson a $264,705 game check.
It marked the third time this season that Goldson, who signed a lucrative offseason contract to join Tampa Bay, has been penalized by the league for an illegal hit.
On the day his ban was rescinded, Goldson said he'd try to play smarter.
Goldson also was fined $30,000 for striking a defenseless player in the head and neck area in the season opener against the New York Jets.
Information from ESPN.com Tampa Bay Buccaneers reporter Pat Yasinskas contributed to this report.