The Captain Salem Avery House was built c. 1860 on the Banks of the West River in Shady Side, Maryland. Captain Avery, a Long Island fisherman, came to the area to make his living from the abundant waters of the Chesapeake Bay. He married Lucretia Weedon of Mayo, Maryland, and they lived in the house for thirty years raising a large family.