Improved Tensorboard integration

[ToucheSir]

Just a catch-all for what we might want out of https://github.com/PhilipVinc/TensorBoardLogger.jl/ and related libraries, including gaps in the ecosystem.

[ToucheSir]

Creating a list from discussions on Zulip:

• sample data
  • images
  • text
  • audio
• model weights (histograms, embeddings)
• model graphs
• statistics: time, GPU utilization, profiler information
• metrics
• hyperparameters (ref. Support for hparams JuliaLogging/TensorBoardLogger.jl#77)
• configuration/metadata

[darsnack]

Any update to this give the callback integration in FluxTraining.jl?

[ToucheSir]

Updated the checklist above with what's done already. We can link those to FluxTraining issues or PRs as they come up.

[lorenzoh]

See the FluxTraining.jl documentation: https://lorenzoh.github.io/FluxTraining.jl/dev/docs/features.html#logging

[lorenzoh]

Should this be closed? I think FluxTraining.jl provides nice enough integration with TensorBoard.

[ToucheSir]

I would be comfortable closing this after one or more of sample data and hyperparams (i.e. the hparams view) are present, but not before. Closing might give the impression that those are implemented or a wontfix.