The wealth he made from the war antagonized his constituents, who burned his factories during the 1863 Draft Riots. (Pictorial Press Ltd./Alamy Stock Photo)