In September 1925, Shemp married Gertrude Frank (March 12, 1905 - May 17, 1982), a fellow New Yorker. They had one child, Morton (February 26, 1927 – January 13, 1972). Gertrude Frank Howard outlived her husband and son, and was living when the son of her father's brother, Barney Frank (born 1940), became a US Congressman. Barney Frank's, father was Shemp's wife's first cousin. Shemp used his somewhat homely appearance for comic effect, often mugging grotesquely or allowing his hair to fall in disarray. He even played along with a publicity stunt that named him "The Ugliest Man in Hollywood". ("I'm hideous," he explained to reporters.) Notoriously phobic, his fears included airplanes, automobiles, dogs, and water. According to Moe's autobiography, Shemp was involved in a driving accident as a teenager and never obtained a driver's license.