Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train high dimensional features #15

Open
JoannaCCJH opened this issue Sep 25, 2024 · 4 comments
Open

Train high dimensional features #15

JoannaCCJH opened this issue Sep 25, 2024 · 4 comments

Comments

@JoannaCCJH
Copy link

Hi! If I want to train and render an additional high-dimensional feature vector for each Gaussian, should I revise the following part in gaussian_render? Besides this part, what else should I do?

render = ms.alpha_blending(
                    uv, conic, opacity, high_dim_feature,
                    gaussian_ids_sorted, tile_range, bg_color[0].item(), width, height, ndc
                )

I tried to render an already-trained Gaussian model with high-dim features, but the rendered features were not as expected.

@yGaoJiany
Copy link
Collaborator

If high_dim_feature has a shape of [P, N, C], it should work. The feature maps will be obtained through alpha blending.

@JoannaCCJH
Copy link
Author

If high_dim_feature has a shape of [P, N, C], it should work. The feature maps will be obtained through alpha blending.

Can you elaborate more on what P, N, C represent respectively? I originally thought the shape should be like [N, C] where N is the number of Gaussian and C is the channel number

@yGaoJiany
Copy link
Collaborator

Hmm, I've made an mistake. The correct notation is [P, C], where P represents the point number and C denotes the channel. You're absolutely right.

@yGaoJiany
Copy link
Collaborator

Would you be so kind as to provide some data for this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants