Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed behavior in git vs v2.12 #24

Open
flying-sheep opened this issue Jul 12, 2019 · 2 comments
Open

Changed behavior in git vs v2.12 #24

flying-sheep opened this issue Jul 12, 2019 · 2 comments

Comments

@flying-sheep
Copy link
Collaborator

@igordot wrote:

Actually, I have an update on this issue. I tested the new version on a few different data sets. Most of them come out essentially the same, but there is one data set that produced very different results.

This is the result with 2.12:
image

And this is the with the GitHub version:
image

The first one is roughly what one would expect and the second one is not. I tried subsampling the number of cells. I am showing 5000 cells above. Reducing it to 4500 yielded a plot that looks normal with both versions, so it seems like the input data is mostly okay.

Do you know what may be causing this?

@flying-sheep
Copy link
Collaborator Author

We have to figure out if this is a bug in my new logic from 1008274 or an effect of the switch to RSpectra in b4e8dad. There were no other relevant changes since then.

  1. Please check if it’s a logic bug by installing a version doesn’t have the logic change and test there, i.e. devtools::install_github('theislab/destiny', ref='fbf6f29b4f3eab54095b2c96da27173619babc52')
  2. Please check if it’s a random thing by trying several seeds before recreating the diffusion map: set.seed(1), set.seed(2), …

Due to the subsampling making a difference, I suspect that the data just gives unstable results, and using different seeds might make a difference.

@igordot
Copy link

igordot commented Jul 12, 2019

I will give it a try. I can also share the input matrix if you'd like.

Regarding subsampling, I was using the same input matrix for both versions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants