Goulding began his professional career as a development player with the Brisbane Bullets during the 2006–07 NBL season. He made his NBL debut and lone appearance of the season on 23 December 2006 against the Townsville Crocodiles, recording one assist in 5½ minutes. The Bullets went on to win the NBL championship in March 2007, earning Goulding his first title. He appeared in 15 games for the Bullets during the 2007–08 NBL season, but following the club's collapse, he moved west for the 2008–09 NBL season to play for the Perth Wildcats.
Between 2006 and 2009, Goulding played with the Southern Districts Spartans in the QBL (2006) and SEABL (2007–09). In 2006, he was a member of the Spartans' championship-winning team. As a member of the Spartans for three seasons in the SEABL, Goulding won East Youth Player of the Year two consecutive seasons in 2008 and 2009 while also making the All-Star Five in his last year. In 2008, he averaged 24.5 points per game to finish second in the competition and had a season-high 43 points during the season. In 2009, averaged 20.8 points to finish fifth, second in free throw percentage (83%), ninth in three-point percentage (39%) and seventh in assists (three). Between 2010 and 2012, he played three seasons for the Northside Wizards in the QBL, earning All-League Team honours in 2010. In 2013, he had a three-game stint with the QBL's Gladstone Port City Power.