Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Wasserstein discriminant analysis (WDA) with stochastic gradient descent #666

Answered by rflamary
palVJ asked this question in Q&A
Discussion options

Thanks very much for this brilliant repo making optimal transport analysis easier for many!

I am wondering whether WDA is possible to use with stochastic gradient descent (SGD). I ask because I am working with a very large high-dimensional data set. Based on the information here: https://pythonot.github.io/gen_modules/ot.dr.html#id15
I am not sure whether this is possible as of today, but I may be wrong.

The way I understand it, SGD should be applied by choosing the appropriate solver which should be of type pymanopt.optimizers (previously pymanopt.solvers). However based on comment here pymanopt/pymanopt#60 it has been worked on by individuals, but not implemented in general in the pymanopt package, so one would need to manually do the necessary changes.

Is my understanding correct so far, or am I missing something?

Cheers

You must be logged in to vote

Yes it is no implemented in POT but you might be able to use SGD to solve WDA with gradient computation on batches using functions from POT. Still note that I have no idea how the gradient of the ratio of batches is biased wrt the true WDA ratio that is optimized.

Replies: 1 comment

Comment options

Yes it is no implemented in POT but you might be able to use SGD to solve WDA with gradient computation on batches using functions from POT. Still note that I have no idea how the gradient of the ratio of batches is biased wrt the true WDA ratio that is optimized.

You must be logged in to vote
0 replies
Answer selected by palVJ
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
2 participants
Converted from issue

This discussion was converted from issue #665 on July 29, 2024 08:05.

AltStyle によって変換されたページ (->オリジナル) /