"I was honored the Baltimore Orioles expressed interest in me as a candidate for their GM position," Baird said, according to the Boston Globe. "The opportunity to possibly work side by side with Buck Showalter was very attractive. At the end of the day it came down to my loyalty to the Red Sox (and) Ben Cherington."
Multiple outlets had reported the O's interest in interviewing Baird earlier Friday.
Baird, a New Hampshire native who has been with the Red Sox since 2006, has big league GM experience, having served in that role with the Kansas City Royals from 2000 to 2006.
This is the second candidate in two days to withdraw his name from the O's list.
On Thursday, Dodgers assistant general manager DeJon Watson removed himself from consideration, a source told ESPNLosAngeles.com's Tony Jackson.
Former Red Sox GM Dan Duquette is still under consideration, and will be interviewed for the Orioles' job, according to reports.