The genius was one of the family spirits of the household. He represented the male lineage, the 'manhood' of the family. And his domain also concerned the ability to father children.
Given the prominence men enjoyed within the Roman family, the genius was seen as a spirit of some considerable importance to the household.