on the safe side
on the safe side {adv. phr.}
Provided for against a possible emergency; well prepared.
"Please double-check these proofs, Mr. Brown," the printer said, "just to be on the safe side."
Categories:
Source: A Dictionary of American Idioms