Machine learning
Adam’s first-moment estimate starts at 0 with β₁ = 0.9.
AdvancedNumeric answer
Adam’s first-moment estimate starts at 0 with . The first gradient is 2. What is the bias-corrected first moment after this step?
Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Report an issue with this question
Learn the method
More machine learning questions
- Gradient descent with momentum uses a learning rate of 0.01 and β = 0.9.Applied · Premium
- Gradient descent on f(x) = x² starts at x = 1 with learning rate 0.1.Applied · Premium
- A quadratic loss has Hessian eigenvalues 4 and 0.5.Applied · Premium
- One step of gradient descent, part 2 of 4Applied · Premium
- You increase the batch size from 32 to 512 without changing anything else. What happens?Advanced · Premium
- One step of gradient descent, part 3 of 4Advanced · Premium