[afpacket] Fix race with Close() seen in CI

[afpacket] Fix race with Close() seen in CI #71597