Bush was named Chief Executive of the War Board of the Port of New York in 1917, during World War I. This would later become the Port Authority of New York and New Jersey.
In 1917, B.C. Forbes also placed Bush alongside Elbert Henry Gary (the namesake of Gary, Indiana). Forbes named Bush within a brief list of notable American businessmen (including hotelier Ellsworth Milton Statler) who were examples of the type of businesspeople whose "industrious, diligent, vigilant foundation-laying" could lead to successful business enterprises.
Bush owned two yachts that subsequently served as patrol boats in the United States Navy. In 1917, during the First World War, the navy bought his 164-foot-long (50 m) steam yacht Christabel and commissioned the vessel as the USS Christabel (SP-162), which took part in at least two actions against German U-Boats and was credited with sinking one. (See Navy History website) A sailor even won a Medal of Honor during one of these engagements. His larger 185-foot-long (56 m) diesel yacht, Coronet, built for him in Germany in 1928 and placed under his wife's name during the Great Depression, was bought by the Navy during World War II and patrolled the Caribbean as the USS Opal (Pyc-8) before being transferred to Ecuador in 1943, where it was scrapped in 1960.