Andrew was an enslaved worker who lived and worked at Tuckahoe during the Allen period. His birth date was recorded as October 12, 1858 to parents Ellen Anderson Smith and Ed Smith. His siblings were Daniel, Jane, Dilsey, Jordan, Nancy, and Harriet.
He and his family lived in the North Cabin which still stands along Plantation Street. About a month after his birth, Mr. Allen recorded in his account that the Smith family had 5 blankets. They would have had 9 family members at the time.
After the Civil War, it seems that some of the Smith family stayed in the area. The 1870 census lists Ellen and Ed in Goochland County but Andrew was not living with them at the time. It is unknown if he lived nearby or if he left the area entirely.