Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tutorials] Configuring lights/shadows for RenderEngineVtk #22060

Open
SeanCurtis-TRI opened this issue Oct 18, 2024 · 2 comments
Open

[tutorials] Configuring lights/shadows for RenderEngineVtk #22060

SeanCurtis-TRI opened this issue Oct 18, 2024 · 2 comments
Assignees
Labels
component: tutorials Drake's tutorials, examples, and website content type: feature request

Comments

@SeanCurtis-TRI
Copy link
Contributor

SeanCurtis-TRI commented Oct 18, 2024

Is your feature request related to a problem? Please describe.
Configuring lighting in RenderEngineVtk can be tricky. It includes such interesting topics such as:

  • Environment maps
    • HDR vs LDR
    • Not only a source for reflection/refraction but introduce light energy into the scene
    • Ambient light.
  • Shadows
    • Not all lights cast shadows.
    • Not all lights cast shadows for all configurations.
    • Not all otherwise valid configurations will produce meaningful or even visible shadows.
    • There are practical workflows for configuring shadow-cast lights (and debugging them).
  • Balancing lights and environment maps
    • When using explicit lights and environment maps together, the amount of light energy must be "balanced".
  • Exposure
    • It is possible to introduce to much light energy into the scene and "over expose" the final image (lots of fully saturated pixels).
    • Tuning exposure will reduce and rebalance the energy in the final image (like changing aperture and shutter speed on a camera to reduce how much energy hits the film/ccd).

A tutorial to help end users understand how to better configure their lights would simultaneously better inform them of what is (and what is not) possible but also improve workflows so they can achieve a desired end result more efficieintly.

It can/should also include CameraConfig and RenderEngineVtkParams. Making mention of the other RenderEngine implementation is worthwhile but they need not be featured.

Describe the solution you'd like
Add to our deepnote tutorials.

Describe alternatives you've considered
n/a

Additional context
One of the single greatest challenges is being able to show the rendered images in the tutorial. (Or, akin to meshcat, be able to stream them to some other URL so that the user can open another browser window to see the image.) However, embedded would be preferred. As pointed out below, embedded images has already been done.

@SeanCurtis-TRI SeanCurtis-TRI added type: feature request component: tutorials Drake's tutorials, examples, and website content labels Oct 18, 2024
@SeanCurtis-TRI SeanCurtis-TRI self-assigned this Oct 18, 2024
@jwnimmer-tri
Copy link
Collaborator

One of the single greatest challenges is being able to show the rendered images in the tutorial.

The rendering_multibody_plant tutorial already has examples of render engine images displayed inline in the notebook. That's only still frames (not live video) but for a static tutorial that's the best we can do.

@SeanCurtis-TRI
Copy link
Contributor Author

Blech. I skimmed the tutorial list too quickly. I should've at least looked in the 'r's for "rendering". Thanks.

@jwnimmer-tri jwnimmer-tri changed the title Need a tutorial on configuring lights/shadows for RenderEngineVtk [tutorials] Configuring lights/shadows for RenderEngineVtk Nov 1, 2024
@SeanCurtis-TRI SeanCurtis-TRI moved this from Todo to In Progress in #dynamics (Drake board) Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component: tutorials Drake's tutorials, examples, and website content type: feature request
Projects
Status: In Progress
Development

No branches or pull requests

2 participants