The Role of the Gather-and-Aggregate Mechanism in Language Models