The iconic varsity jacket is truly All-American. The varsity jacket, (first referred to as a letterman's jacket) origins can be traced all the way back to Harvard University in the year 1865. By the 1950s the Iconic Varsity jacket was a right of passage for high school athletes to those belonging to elite college teams.