I guess what the contractor was saying was that since some of the form board will be left underground, it would be pointless to remove only part of it.
(the visible section)

In other words, he wasn't going to dig out what couldn't be seen