I will report on recent work with Aukosh Jagannath and Reza Gheissari on the performance of gradient descent algorithms during the initial phase of the minimization of high dimensional loss functions, and try to understand how they manage to escape the region of maximal entropy.