UK troops in Helmand alienated the population and strengthened the Taliban, according to a study.