Machine learning
Gradient descent with momentum uses a learning rate of 0.01 and β = 0.9.
AppliedNumeric answer
Gradient descent with momentum uses a learning rate of 0.01 and . What is the effective step size on a constant gradient?
Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Report an issue with this question
Learn the method
Of the kind reported at
Jane Street, Citadel, Hudson River Trading, Jump Trading, D. E. Shaw
More machine learning questions
- A quadratic loss has Hessian eigenvalues 4 and 0.5.Applied · Premium
- One step of gradient descent, part 2 of 4Applied · Premium
- You increase the batch size from 32 to 512 without changing anything else. What happens?Advanced · Premium
- Adam’s first-moment estimate starts at 0 with β₁ = 0.9.Advanced · Premium
- One step of gradient descent, part 3 of 4Advanced · Premium
- One step of gradient descent, part 4 of 4Expert · Premium