John Tyler renamed the plantation Sherwood Forest in 1842. He said it signified that he had been "outlawed" by the Whig party. He was attracted to the plantation because it was near his birthplace at Greenway Plantation. He retired there when he left the White House in 1845 and spent the rest of his life there with his second wife and some of his children - he had eight with his first wife, and seven with his second wife including the last one when he was age 70.

In 1862 the house was occupied by Union soldiers during McClellan's Peninsula Campaign of 1862 and again during Grant's Overland Campaign in 1864. During the latter, the Battle of Wilson's Wharf was fought nearby. When an Ohio regiment vacated the house in 1864, they attempted to raze it with fire as a punishment for Tyler's support of the Confederacy. The fire was quickly extinguished by a loyal slave and did little damage to the house.

Owners of the house who started restoring it in the mid-20th century started removing some home-made storm windows and then discovered from old records that Tyler had built them himself, so they kept them. One of the house's claims to fame is the length of the house; over 300 feet. It is also noted for its long, skinny ballroom, a "hyphen" Tyler had added to the house to accommodate the style of dancing popular then - what is today called "line dancing" but was then the "Virginia reel."

The house has been in the Tyler family since it was purchased by President Tyler in 1842. The house is currently owned by Harrison Ruffin Tyler, President Tyler's grandson, and the son of Lyon Gardiner Tyler. It is open to the public for tours.