why softmax get small gradient when the value is large in paper 'Attention is all you need'
The Vanishing Gradient Problem in Softmax Understanding the Attention Mechanism in Attention is All You Need The seminal paper Attention is All You Need revolut