You only work on poetry.
(How do you teach it, anyway?)
All you know how to do is write your books.
You don't do cultural studies.
You are narrow.
You are dogmatic.
You are too competitive.
You aren't interdisciplinary enough.
The negative messages you get from others can affect even things that that are actually your strengths. So in my case, specializing in something that presumably nobody cares about, being overspecialized, wanting to be the best at what I do, taking strong positions, etc...
When, in fact, people do care about what I write and recognize my work as interdisciplinary and broadly "cultural." I suppose I should have done a book on historical memory or some other topic that everyone else seemed to be working on.
But actually, books by other people who are also excellent scholars don't follow predictable paths either. None of us just writes the standard academic book over and over again.