In 1953 he set two more records (this time on the UK charts): weeks at No 1 for a song ("I Believe", which held the number one spot for 18 weeks), and weeks at No 1 for an artist in a single year (27 weeks), when "Hey Joe!" and "Answer Me, O Lord" became number one hits as well). In spite of the popularity of rock and roll artists such as Elvis Presley and The Beatles, fifty-plus years later, both of Laine's records still hold.
In 1953, Laine recorded his first long playing album that was released, domestically, solely as an album (prior to this his albums had been compiled from previously released singles). The album was titled "Mr. Rhythm", as Laine was often known at that time, and featured many jazz-flavored, rhythm numbers similar in style to his work on the Mercury label. The album's songlist was made up of "Great American Songbook" standards. The tracks were "Some Day, Sweetheart", "A Hundred Years from Today", "Laughing at Life", "Lullaby in Rhythm", "Willow, Weep for Me", "My Ohio Home", "Judy" and "After You've Gone." The final number features a rare vocal duet with his accompanist/musical director, Carl Fischer. Paul Weston's orchestra provided the music.
Released as a 10" in 1953, and a 12" in 1954, this album features the talents of Laine, Jo Stafford and bandleader Paul Weston, a Tommy Dorsey alumnus who led one of the top bands of the 1950s, and was the husband of Stafford. The album was a mix of solo recordings and duets by the two stars, and of new and previously released material, including Stafford's hits single, "Make Love to Me", "Shrimp Boats", and "Jambalaya." Laine and Stafford duetted on "Way Down Yonder in New Orleans", "Floatin' Down to Cotton Town", and "Basin Street Blues"; and Laine soloed on "New Orleans" (not to be confused with "New Orleans" a.k.a. "The House of the Rising Sun" which Laine later recorded), "Do You Know What It Means to Miss New Orleans?", and "When It's Sleepy Time Down South", along with a pair of cuts taken from his "Mr. Rhythm" album.