Williams did not begin playing rugby until 1998 when, aged 17 during his time in Greenbank house at King’s college. He played for the King’s College Second XV. He had already represented Auckland at junior level in soccer, tennis and cricket. In 1999, he was a member of the King’s College First XV and at this stage he decided to concentrate on rugby. Williams attributed much of his early success to 1st XV coach Mark Kennelly. He began a business studies course at Auckland University of Technology, but after playing club rugby and spending time at the Auckland Rugby Academy, he was selected to make his first class debut for Auckland in a National Provincial Championship (NPC) match against Taranaki on 24 August 2001. The following year he was named in the Blues squad for the Super 12 and made his debut against the Hurricanes in the opening game of the season, on 22 February 2002. Later that year, he was selected for the All Blacks’ year-end tour to England, France and Wales; he played in all three Test matches, making his international debut against England at Twickenham on 9 November 2002.

Following the 2002 year-end tour to Europe, Williams became a regular member of the All Blacks. He started in all three matches against touring Northern Hemisphere teams, in June 2003, though he could have missed the games against Wales and France, after being cited for stamping on the head of England fullback Josh Lewsey; he was cleared of the charge when a disciplinary tribunal ruled that his actions had been “inadvertent and incidental”. He started in all four matches in the 2003 Tri Nations Series, before being chosen in the All Blacks squad for the 2003 Rugby World Cup. He almost did not make the squad, after suffering a stress fracture of the right foot during the All Blacks training camp in New Plymouth, an injury that required the insertion of a pin, but was included on the strength of his line-out play. He was rested for the first two pool matches, against Italy and Canada, but started in the remaining five games that New Zealand played, scoring his first international try in the final pool game, against Wales, when he jumped above the Welsh wing Shane Williams, to collect a cross-field kick from Carlos Spencer. French back, and newspaper columnist, Thomas Castaignède named Williams and England’s winning captain, Martin Johnson as the locks in his “team of the tournament”.

At the start of the 2004 season, Williams failed to impress new All Blacks coach Graham Henry. Struggling to recover from the foot injury sustained just before the World Cup, he was below his best in the Super 12. Also, Henry was looking for locks who could perform well in the tight forward role, whereas the athletic and mobile Williams was viewed as a forward who was happier operating in loose play. For the trial match between “Probables” and “Possibles”, he was chosen merely as a replacement for the “Possibles”, and he was left out of the squad to face England, Argentina and the Pacific Islanders, and missed the next five Tests, including the opening match of the 2004 Tri Nations against Australia. He was called into the squad before the Pacific Islands match, as cover for the injured Keith Robinson, but was not used, and he was left out of the squad for the Tri Nations. When Robinson had to withdraw from the opening game, it was Simon Maling, not Williams, who was called up to replace him. Williams was recalled to the squad for the next game, against South Africa, in which he came on as a substitute, and started in the return fixture against Australia, a game which the All Blacks lost and in which Williams was sin-binned after New Zealand were adjudged to have infringed repeatedly. After an indifferent performance against Australia—according to coach Graham Henry, “we thought Ali Williams had an opportunity on Saturday and didn’t take it”—Williams was dropped from the squad for New Zealand’s last game in the 2004 Tri Nations, against South Africa, who won comprehensively, out-scoring the All Blacks by five tries to two.

Despite a lack of game time during the 2005 Super 12 season—he was suspended for six weeks after being found guilty of trampling on fellow All Black Richie McCaw during the game between the Blues and Crusaders—Williams was chosen to start in the opening Test of the All Blacks season, a 91–0 rout of Fiji, during which he scored his second international try. His third came two weeks later, in the first Test against the touring British and Irish Lions, a game in which he dominated the line-out, winning the ball several times on the opposition’s throw, most effectively in the 24th minute, when, having caught the ball on a Lions’ defensive line-out, he spotted a gap in the opposing line, darted through it and, shaking off an attempted tackle by the Lions half-back, Dwayne Peel, drove over the goal-line for the All Blacks’ first try of the match. He started in all three Tests against the Lions, and scored his fourth international try in the final Test, when Dwayne Peel fumbled a grubber kick from Luke McAlister, and Williams pounced on the loose ball in the in-goal area. He started in all four of New Zealand’s matches in the 2005 Tri Nations Series and came close to scoring another try in the last game, against Australia, on his home ground, Eden Park, but, after winning the ball at an Australian line-out and making a 20-metre break, his attempted grubber kick was wayward. He did, however, create the second of wing Doug Howlett’s three tries in the game when, from within the Australian 22, in front of the posts, he executed a fine cross-field kick that Howlett caught on the far right of Australia’s in-goal area for an easy touch-down. In 2009 Williams released his biography “Ali: Tall Book of Tales”. It was during this time in which he spoke of an incident involving Clint Brown then TV anchor for 3 News who was stripped naked by Williams and members of the All Black team and had his eyebrows shaved off after becoming heavily intoxicated on a flight from South Africa to Australia.

At the start of the 2006 season, the All Blacks faced an awkward schedule, with two home Tests against Ireland to be followed, a week later, by a Test against Argentina in Buenos Aires. Williams was selected in the squad to face Ireland, but suffered a syndesmosis injury—commonly referred to as a high ankle strain—during a training session. Chris Jack, who had originally been included in the starting line-up for the Argentina game, was brought in to replace him, and Williams took Jack’s place for the game in Buenos Aires. Williams was named on the bench for the first match in the 2006 Tri Nations Series, against Australia in Christchurch; he replaced Jason Eaton with 20 minutes remaining and came close to creating a try when he leapt high to retrieve a cross-field kick from Dan Carter, tapping it back to wing Rico Gear, who was unable to hold on to the ball. He started in the next two matches, against South Africa in Wellington and Australia in Brisbane, being replaced late in the latter game by Eaton, who replaced him in the starting line-up for the return match against Australia in Auckland. Williams again came off the bench with less than an hour gone, and then played the full 80 minutes in the All Blacks’ remaining two fixtures, both against South Africa away from home.

Williams’s troubles with the Blues had no impact on his international career, as he was included in the New Zealand squad for the two-Test series against France in June 2007. He started both Tests, but suffered a serious injury in the second Test, on 9 June, when he fractured his jaw while tackling French number eight Sébastien Chabal. As a result, he missed the whole of the 2007 Tri Nations Series. But despite having his jaw wired and being forced to subsist on soup for several weeks, he made a return to rugby for his club side, Ponsonby, at the end of July, scoring two tries, and started for Auckland in their Air New Zealand Cup match against Bay of Plenty on 3 August, scoring a try in the fourth minute of the game. Coincidentally, this was the first time that Williams and his younger brother, Jay, had played together as locks in first-class rugby.

In 2007, Williams was one of the 22 players withdrawn from the first half of the Super 14 season to attend a “conditioning camp”, as part of the All Blacks’ World Cup preparations. Although he became available for the Blues in week 8 of the tournament, he was left out of the squad that week, was on the bench in week 9, and did not make his first start of the season until week 10, when the Blues played the Cheetahs. A week later he was back on the bench for the Blues game against the Sharks . A few weeks later, “for disciplinary reasons”, Williams was left out of the squad to face the Sharks in Durban in a S14 semi-final match—which the Blues lost—and returned home to Auckland. Blues chief executive Andy Dalton told the press that management and senior players had made a joint decision to eject Williams from the team camp over incidents which occurred during the team’s stay in Perth, Australia, where they had played the Western Force. “On several occasions (Williams’s) behaviour has been deemed inappropriate within team conduct and protocol and on at least four occasions Williams has been addressed by either coach David Nucifora and manager Ant Strachan or the leadership group on behalf of the team”, Dalton said. In response, Williams said that he took “a bit of responsibility” for his actions but that “it takes two to tango”.

In August 2007, Ali Williams announced that he had signed a new contract with the NZRU that would keep him in New Zealand until the end of 2009 and that he was signing for the Tasman Makos for 2008, so as to be eligible for selection for the Crusaders in the 2008 Super 14 season. Salary cap restrictions prevented a move to Canterbury, but his contract with Tasman has an option that would allow him to be loaned to Canterbury for the 2008 ANZ Cup. Williams was duly included in the Crusaders squad when New Zealand’s 2008 Super 14 teams were announced, in October 2007.

In 2010, Williams spoke in a radio advertisement for his bottled water company, making claims about the health benefits of drinking more water. A complaint to the Advertising Standards Authority New Zealand was settled without being submitted to the full ASA Board, because the advertisement had been discontinued.

In December 2011, Williams married his long-time girlfriend Casey Green in Queenstown. Williams then became a father in April 2013, his wife giving birth to a baby girl, Jessica Harriet.

In July 2013 was announced that Ali Williams signed a one-year contract with the European champion Toulon

Williams retired from rugby at the end of the 2014–15 northern hemisphere season. Several months later, he was hired by the Paris-area club Racing 92. He was to serve primarily as media advisor for fellow All Black Dan Carter, who arrived in Paris to play for Racing after the All Blacks’ victory in the 2015 Rugby World Cup. Racing determined that the demands on Carter’s time were great enough to justify a special advisor.

In February 2017 Williams was arrested in Paris, caught allegedly trying to buy cocaine outside a nightclub. He was with former Wallabies star James O’Connor, who was also arrested. In April 2017, following an investigation of Williams and O’Connor’s conduct, Williams was fined and dismissed from Racing 92.