If we're looking at both fighters at their best, I'll take Young. There were times in Young's inconsistent career where he was way too inactive in the ring and could be outhustled, but Young from the time of the Ali, Lyle, Norton & Foreman fights beats Patterson.
