Jimmy Johnson was a standout multi-sport athlete at Sam Rayburn High School before starring as a fullback for the University of Texas. As a teenager, he helped lead the Pasadena Colt All-Stars to the Colt World Series title. He was drafted by the Houston Astros after his senior season in 1976.

At Texas, Johnson played on the final team coached by Darrell Royal and was a key contributor on the 1977 team that featured Heisman winner Earl Campbell and finished the regular season undefeated. During his freshman season, Johnson became the first Longhorn to score three touchdowns in a single contest. He completed his collegiate career with an appearance in the Cotton Bowl.

Johnson is remembered as one of the most well-rounded athletes in Sam Rayburn history. He earned three varsity letters in both football and baseball, and two letters in track. He was inducted into the Pasadena ISD Athletics Hall of Fame in 2014.