John Carlyle built the Carlyle mansion for his wife Sarah Fairfax. Scotland’s stone architectural culture influenced Carlyle, and his use of stone was unique for the Alexandria area where wooden structures were the norm.