Downey, Lacy and Wolff hit two 3-pointers apiece as UNC-Wilmington went 7-for-13 from beyond the arc.
Elon pulled within 20-12 on Chris Long's jumper with just over 10 minutes left in the first half, but the Seahawks went on a 20-6 run from that point to take a 22-point halftime advantage.
Fields opened UNC-Wilmington's second half with a pair of jumpers and Wolff followed with a 3, capping a 7-0 run that put the game out of reach.
Terrance Birdette scored 13 points to pace the Phoenix (2-5), who have dropped three straight. Elon finished 5-for-22 from 3-point range.