I have taken a shortcut with William, and much of the information about him is taken from Mandy Willard's page about him.
William Allfrey (senior) was born in around 1821-1822 in Keymer or Clayton, both in Sussex.
William married three times. Most important to us was his first marriage to Audrey Sheppard (née Vincent)
He married Sarah (born in Chorley, Sussex in around 1832).
In 1861 he was living in West Street, Clayton, Sussex with his wife Sarah and three children: William, George and Frank. His profession was a bricklayer (not a brick labourer!).