Rogers does hold a higher position in the staff than most of the house-elves, yes.

And Harry will probably have to relax, eventually. If he'll do it in time is a different question.