Not only this annoyance you mentioned, but my personal little saying is that turn signals aren’t just for the benefit of who you see, but more importantly for anyone you don’t see!

You should have already made sure you’re clear of everyone before you think about leaving your current path. Using the indicator is a preventative measure for the sake of yourself and anyone in a blind spot or that you failed to notice.