Cannonball moved to Tallahassee, when his parents obtained teaching positions at Florida A&M University. Both Cannonball and brother Nat played with Ray Charles when Charles lived in Tallahassee during the early 1940s. Adderley moved to Broward County, Florida, in 1948 after finishing his music studies at Florida A&M and became the band director at Dillard High School in Fort Lauderdale, a position which he held until 1950.

Originally from Tampa, Florida, Adderley moved to New York in 1955. His nickname derived from “cannibal”, a title imposed on him by high school colleagues as a tribute to his voracious appetite.

Cannonball left Southeast Florida and moved to New York City in 1955. One of his known addresses in New York was in the neighborhood of Corona, Queens. He left Florida originally to seek graduate studies at New York conservatories, but one night in 1955 he brought his saxophone with him to the Café Bohemia. Cannonball was asked to sit in with Oscar Pettiford in place of his band’s regular saxophonist, who was late for the gig. The “buzz” on the New York jazz scene after Adderley’s performance announced him as the heir to the mantle of Charlie Parker.

Adderley formed his own group with his brother Nat after signing onto the Savoy jazz label in 1957. He was noticed by Miles Davis, and it was because of his blues-rooted alto saxophone that Davis asked him to play with his group. He joined the Davis band in October 1957, three months prior to the return of John Coltrane to the group. Some of Davis’s finest trumpet work can be found on Adderley’s solo album Somethin’ Else (also featuring Art Blakey and Hank Jones), which was recorded shortly after the two giants met. Adderley then played on the seminal Davis records Milestones and Kind of Blue. This period also overlapped with pianist Bill Evans’ time with the sextet, an association that led to recording Portrait of Cannonball and Know What I Mean?.

His interest as an educator carried over to his recordings. In 1961, Cannonball narrated The Child’s Introduction to Jazz, released on Riverside Records. In 1962, Cannonball married actress Olga James.

By the end of the 1960s, Adderley’s playing began to reflect the influence of electric jazz. In this period, he released albums such as Accent on Africa (1968) and The Price You Got to Pay to Be Free (1970). In that same year, his quintet appeared at the Monterey Jazz Festival in California, and a brief scene of that performance was featured in the 1971 psychological thriller Play Misty for Me, starring Clint Eastwood. In 1975 he also appeared in an acting role alongside José Feliciano and David Carradine in the episode “Battle Hymn” in the third season of the TV series Kung Fu.

In July, 1975 Adderley suffered a stroke from a cerebral hemorrhage and died four weeks later, on August 8, 1975, at St. Mary Mercy Medical Center in Gary, Indiana. He was 46 years old. He was survived by his wife Olga James Adderley, parents Julian C. and Jessie L. Adderley, and brother Nat Adderley. He was buried in the Southside Cemetery, Tallahassee.

Later that year he was inducted into the Down Beat Jazz Hall of Fame. Joe Zawinul’s composition “Cannon Ball” on Weather Report’s Black Market album is a tribute to his former leader. Pepper Adams and George Mraz dedicated the composition “Julian” on the 1975 Pepper Adams album of the same name days after Cannonball’s death.