It is the way the world of trademarks work. If you do not defend them, you lose them. This includes even very minor infringements (think mom and pop), not even something large like U of Houston.