on the whole vs all in all

on the whole and all in all both are adverbs.

Word	Noun	Adjective	Verb	Adverb
on the whole	No	No	No	Yes
all in all	No	No	No	Yes

As adverbs, on the whole and all in all are synonyms defined as:

on the whole and all in all: with everything considered (and neglecting details)

Other synonyms of on the whole include altogether, tout ensemble.

on the whole (adverb)	all in all (adverb)
with everything considered (and neglecting details)	with everything considered (and neglecting details)