The property was adjacent to Locust Grove, the farm where George Rogers Clark lived from 1809 until his death in 1818. Before he began his military career in 1808, Zachary Taylor lived twenty years in the house. He would later return to the house to be married on June 18, 1810, and have five of his six children born in the house. In 1829 the house was sold upon Richard Taylor's death, due to debts he had acquired. After his death in 1850, Zachary Taylor was buried in the family cemetery located on the property. This later became the original section of Zachary Taylor National Cemetery. Much of the original Taylor property remained together until the 1950s, when it was divided. Of the original 400 acres, the Taylor property is only 3/4 of an acre in size.

There have been attempts to make the house a National Historic Site, but these attempts have failed due to the required demolition of surrounding buildings needed to make it a National Historic Site. Springfield is a 2-1/2 story Georgia Colonial red brick L-shaped house. The western section of the house is the oldest, built around 1790. The eastern section was built between 1810 and 1830. It features a gable roof, a double-parlor, and fireplaces in each room. It was constructed by Richard Taylor and the slaves he owned.