Jesse Richardson was born on August 18, 1930 in Philadelphia, and attended Roxborough High School in Philadelphia. He went on to play at the University of Alabama, on the team that won the Orange Bowl in 1953.

He was selected in the 8th round of the 1953 NFL Draft by the Philadelphia Eagles, where he played from 1953 thru 1961, and was cut during the 1962 training camp. He was a member of the 1960 NFL Championship team and was All-Pro in 1959 and 1961.

He moved over to the AFL and played defensive tackle for the Boston Patriots from 1962 thru 1964. He retired because the amount of injuries, he had during his pro career, finally caught up to him.

After retiring from pro football, he served as defensive line coach for the Patriots and served in the same capacity for the Eagles in 1971.

Jesse Richardson passed away from kidney disease on June 19, 1975, at age 45, in Philadelphia. His legacy is carried on in the Richardson Memorial Dialysis Section of Philadelphia's Mercy Catholic Hospital.