I would never allow federal agents into my home without a warrant. Nor would I allow them to interview my family. It is never good to be interviewed by police or federal agents, anything you say may be held against you. (San Jose, CA)
I have been interviewed by federal agents twice in my home(I don't have family at home). A childhood friend applied for a job with a federal agency that required an intensive background check. It was slightly uncomfortable but not terrible. I'm sure being white and female and a citizen gave me a sense of safety that others would not feel. (San Francisco, CA)
First gut response is no (abuse of power). BUT it depends on the reason. If it's acceptable to me, yes. (Chicago, IL)