Delete Old Configuration Events

We recently decommissioned our old gms server.  I've noticed that we have a number of event errors within the POA logs that contain the old servers ip.  The only posts I found on this forum recommended either manually deleting the events through the POA console or running a gwcheck with DELEVENTSBYKEY.  Both options appear to delete the events for a short time before new events start appearing again.  What am I missing?