to begin with vs in the first place

to begin with and in the first place both are adverbs.

Word	Noun	Adjective	Verb	Adverb
to begin with	No	No	No	Yes
in the first place	No	No	No	Yes

As adverbs, to begin with and in the first place are synonyms defined as:

Other synonyms of to begin with include earlier, in the beginning, originally.

to begin with (adverb)	in the first place (adverb)
before now	of primary import
	before now