In 1879, he and his wife Sara built a family home on the corner of Mountain Avenue and Meldrum Street where they raised their children, Edgar, Ethel, and Louise. The original two-story home consisted of two rooms on the first floor, now the entry area and dining room; three bedrooms upstairs; and a basement. Built of sandstone from local quarries, the cost of the original house was $3,000. During the ensuing years, the Averys added to the house several times; the final addition included the distinctive Queen Anne tower.

Members of the Avery family lived in the house until 1962 when it was sold. The Poudre Landmarks Foundation, Inc. was formed in 1972. The group worked with the City of Fort Collins to purchase the home in 1974 at a cost of $79,000. The Foundation then took responsibility to oversee restoration of the house. In 1981, the Poudre Landmarks Foundation organized the Avery House Historic District Guild to assist with the project.

The house, gazebo, fountain and carriage house are part of the Avery House Historic District listed in the National Register of Historic Places.

The Avery House is open Sunday and Wednesday afternoons from 1-3pm. Please check the Calendar for special events and exhibits. You may also leave a message for the Avery House Guild at the following number: (970)221-0533.