Madison is a city in Morgan County, Georgia, United States. The population was 3,636 at the 2000 census. The city is the county seat of Morgan County. Most of its nearly 100 Antebellum homes have been carefully restored, which led to Holiday Travel magazine's naming Madison "The Prettiest Small Town in America. " In 2001, Madison was voted the #1 Small Town in America by Travel Holiday Magazine.