Bivin was the last pitcher to face Babe Ruth in a major league game. In the first game of a doubleheader on May 30, 1935, Bivin coaxed the Babe into a 4-3 groundout in the first inning. The Babe doffed his cap, waved to the Philadelphia crowd at the Baker Bowl, and went into the dugout. His 22-year career was over. Five days earlier he had hit his 714th and final home run.
Bivin spent 15 seasons in professional baseball, but 1935 was his only year at the big league level. It took a terrible team like the Phillies, who were desperate for pitching, for the Mississippi native to get his chance. He went 2-9 and was back in the bushes in 1936. He threw his last pitch at the age of 39 in 1949 for the Greenwood (Mississippi) Dodgers. Known for a good curveball, Bivin won 163 games in the minor leagues. He also served in the U.S. Army for three years during World War II.