If you don’t tend the garden for 4 years, and the gardener you hired is an idiot it is going to take a lot of work to get anything to grow in the garden again,

Of course the situation is made worse because none of your neighbors are talking to you any longer.  They figure anyone dumb enough to hire that gardener deserves what they get.