As nouns,
federal office is a hyponym of
government department; that is, federal office is a
word with a more specific, narrower meaning than
government department:
government department: a department of government
federal office: a department of the federal government of the United States