Author blamed literary success of the fictional detective for his highbrow historical novels ‘lying unread’