Joseph M. Bailey was born June 22, 1833 in Middlebury, NY. His parents were farmers, originally from New England.