As nouns,
sexadecimal notation is a hyponym of
mathematical notation; that is, sexadecimal notation is a
word with a more specific, narrower meaning than
mathematical notation:
mathematical notation: a notation used by mathematicians
sexadecimal notation: any notation that uses 16 different characters