About the year 1638, Benjamin came with the Winthrop Fleet to New England. It is not known whether he married Hannah Miller in England or after he emigrated.

He was a carpenter and one of the earliest settlers in Medfield, MA in 1649. His first house lot of four acres was near Brastow's Bridge. It is not certain if he built there. In 1653, he was granted a house lot in Mendon, MA. It was listed in the Proprietor's Records of Mendon as " Benjamin Albee, a 20 acre lot and 50 acres of land and 6 acres of meadow for the encouragement of a grist mill". He sold his estate in Braintree in 1657, and about that time, he bought the homestead of Thomas Grubb near the corner of Main and Bridge Streets. The Albee family was living there in 1660. Soon after the house was sold to William Cheney. The town records mention that Ben now had a "new house". The location of the new house is not known. In 1660, a house lot was granted to him in Mendon, MA.

He was one of the founding fathers of the Swansea Baptist Church in 1663. He is listed as a constituent member. Several members of that church lived in the Bellingham and Mendon region.

He held many town offices. He served Medfield as a measurer of land and a sealer of weights and measures. He was a member of the first board of Selectmen in of Medfield in 1651. In 1659 he served as a Commissioner to the General Court from Medfield.

Ben is not mentioned in the records of Medfield after 1669. It was about that time the family moved to Mendon. He was chosen selectman at the first Mendon Town Meeting on June 7, 1667.