This architecturally restrained town house is representative of the many middle-class, side-passage dwellings built following Norfolk’s destruction during the American Revolution. It was erected by William Willoughby soon after he purchased the lot in 1794. Willoughby, a local merchant and contractor, was also a descendant of Thomas Willoughby, original owner of the land on which Norfolk was established in 1682. Dr. Byrham Baylor, who married Willoughby’s granddaughter in 1845, probably added the Doric-columned porch and other Greek Revival touches then. In 1964 the Willoughby-Baylor House was spared the demolitions that swept away much of its neighborhood through purchase by the Historic Norfolk Foundation. The foundation restored the house as a museum illustrating the taste of Norfolk’s middle-income families, a contrast to the more elegant Moses Myers House nearby. Stewardship of the Willoughby-Baylor House was transferred to the Chrysler Museum in 1969.