Tricky question, but I think I have a solution:

:!readlink /proc/$PPID/fd/* | grep “$(dirname %)/.$(basename %).sw” | xargs -I{} rm “{}” ; kill -9 $PPID