Skip to main content
Stack Overflow
  1. About
  2. For Teams
Filter by
Sorted by
Tagged with
0 votes
1 answer
82 views

I don't understand the correct procedure for intorducing momentum in neural network training update: suppose you have a dataset of 100 and a minibatch of 90 and train a NN for 2 epochs. I will express ...
0 votes
1 answer
1k views

It seems that torch.optim.SGD may have a bug when momentum is added. From my understanding, one can implement SGD with momentum by simply providing some value for the momentum argument, such as torch....
1 vote
1 answer
6k views

I am a beginner in Unity developing a 2D top-down mobile game. I am trying to create an enemy movement script that mimics the pattern of the leech enemy below: This enemy is constantly trying to move ...
2 votes
1 answer
463 views

I want to construct a momentum factor which is part of Fama and French Regression. We have a monthly data table starting from 1980年12月31日 to 2021年12月31日, and a time series of stock returns, given as a ...
1 vote
1 answer
279 views

I dont want sparkpost to substitute any data in my email Content. I am sending mails one by one (this is my use case). I am facing issues when my content has {{<some random variable }}, sparkpost ...
3 votes
2 answers
2k views

I'm trying to simulate the buttery scroll on mac os / ios, often referred to as "inertia scroll" or "momentum scrolling", as you're going through the page. Everything I found so ...
0 votes
1 answer
37 views

I am programming a function in order to get an over the sample simulation. My function is the following: oos <- function(alpha, rho,rv){ ar_oos <-(alpha + rho*rv) return(ar_oos) } I define ...
3 votes
1 answer
4k views

I am trying to develop a multi time frame indicator using pine script. I use the following line for choosing the prices based on which I can do further analysis. resolution = "D" source = ...
0 votes
2 answers
1k views

I'm creating a Mario clone and I need to keep the player's forward momentum into the jump and then onward into the landing. I can't figure out how to achieve this. Every time I land, the player has to ...
Evan's user avatar
  • 77
0 votes
0 answers
64 views

So I have the following dictionary implemented for vanilla SGD: update_weights = dict(zip(weight_keys, [grad_weight[key] - lr * ...
0 votes
1 answer
971 views

I am new to CNN and was implementing Batchnorm in CNN using keras. The Batch norm layer has 4*Feature_map(of prev layer) parameters. Which are as follows: 2 are gamma and beta The other 2 are for the ...
0 votes
1 answer
461 views

I found a PyTorch implementation that decays the batch norm momentum parameter from 0.1 in the first epoch to 0.001 in the final epoch. Any suggestions on how to do this with the batch norm momentum ...
1 vote
0 answers
370 views

In Keras or Tensorflow clipnorm rescales large "gradients" to have a specific norm and clipvalue bounds all the values of the "gradient". But what happens if you combine one of ...
3 votes
1 answer
2k views

I know you can change the learning rate dynamically in pytorch using schedulers. How can you do the same with momentum?
2 votes
0 answers
260 views

I am using the SGD optimizer and want to set the momentum after initialization similar to learning rate scheduling by using tf.keras.backend.set_value(optimizer.momentum, momentumValue): https://www....

15 30 50 per page
1
2 3 4 5 6

AltStyle によって変換されたページ (->オリジナル) /