cyclopedia vs reference book

cyclopedia and reference book both are nouns.

Word	Noun	Adjective	Verb	Adverb
cyclopedia	Yes	No	No	No
reference book	Yes	No	No	No

As nouns, reference book is a hypernym of cyclopedia; that is, reference book is a word with a broader meaning than cyclopedia:

cyclopedia: a reference work (often in several volumes) containing articles on various topics (often arranged in alphabetical order) dealing with the entire range of human knowledge or with some particular specialty
reference book: a book to which you can refer for authoritative facts

Other hypernyms of cyclopedia include book of facts, reference, reference work.

cyclopedia (noun)	reference book (noun)
a reference work (often in several volumes) containing articles on various topics (often arranged in alphabetical order) dealing with the entire range of human knowledge or with some particular specialty	a book to which you can refer for authoritative facts