There's a marriage bond for Baldwin Farnham and Caroline S. Matthews issued Nov 2, 1836, and they're living together in the 1850 Federal Census. She would not be the mother of the Ayres children. Since he's listed as being a teacher in the 1860 Federal Census, they could be children who were boarding with him in order to get an education, or perhaps relatives of a sister of Caroline's. Neither person is living with Caroline and Baldwin in the 1870 or 1880 Federal Censuses. Cathy