Just digging through census looking for my Fagan lines, and I found a James Fagan born 1841 in Ala. living in Wayne MS, 1910 census. He might be related to your Alabama Fagans.