Beauvoir was the last home of Jefferson Davis and it was the site of his retirement. The house was built by James Brown, a wealthy plantation owner from Madison County, Mississippi. The house was started in late 1848 and was completed in 1852. The house was built as a summer home for his wife and his (eventually 13) children. It was then called Orange Grove, due to the Satsuma Oranges being grown on the property. Mr. Brown died in 1866 and his widow continued to own the property until 1873 when she was forced to sell the property at public auction to pay and satisfy the taxes due on her husband's estate. Frank Johnson, a land speculator purchased the house for taxes and then sold the house and property three months later.