In September 1940, prior to America's entry into WWII, Joe Jones enrolled at Clemson A&M College (now Clemson University). Most Clemson students were also part of the Enlisted Reserve, and Jones reported to Fort Jackson, South Carolina, on June 14, 1943. He attended Basic Training at at Camp Croft near Spartanburg, South Carolina.
On June 14, 1944, Jones commissioned as a 2nd Lieutenant in the infantry branch and was assigned to the 71st Infantry Division at Camp Carson, Colorado. Six months later, the division was sent to Le Havre, France. After a few weeks of combat training, the 71st departed for Nancy, France, to join the 7th Army. Leading a weapons platoon, Jones and his 36 soldiers first saw combat in Bitche, France.