simtools - prototype release v0.6.0

Prototype implementation of tools for the Simulation System of the CTA Observatory.

This is an intermediate development release including major development steps and code improvements.

What's Changed

• Remove running of CI on push to main by @GernotMaier in #559
• Consistent usage of MLTData test file by @GernotMaier in #563
• simplify and fix building of corsika / simtel image by @GernotMaier in #555
• Remove mailmap by @orelgueta in #569
• Reduce number of tests for pull requests. by @GernotMaier in #560
• Change in io_handler::get_output_directory to improve output directories by @GernotMaier in #565
• Add pytest-xdist by @GernotMaier in #576
• Remove dependency of ray-tracing on files by @GernotMaier in #575
• Fix issues with installed packages in the containers by @orelgueta in #577
• Package push trigger by @GernotMaier in #578
• Sort dependencies alphabetical by @GernotMaier in #581
• Read environment variables using the dotenv package by @GernotMaier in #582
• Documentation update: mostly main README, print_array_elements, derive_mirror_rnda; conf.py by @GernotMaier in #570
• Add tests for general.py by @orelgueta in #579
• Corsika histograms with hd5 format by @VictorBarbosaMartins in #572
• Env variables names by @orelgueta in #586
• Remove unneeded calls to simtel_path_no_mock in unit tests by @GernotMaier in #587
• Warnings in unit tests by @orelgueta in #591
• Bump actions/checkout from 3 to 4 by @dependabot in #594
• Add ray tracing unit tests (and a few small fixes) by @orelgueta in #593
• Png files to pdf corsika histograms by @VictorBarbosaMartins in #592
• Add event to push on merged pull request by @orelgueta in #598
• Add simplest integration test for simulate_prod by @orelgueta in #595
• Completing a few to-dos in corsika_simtel_runner by @orelgueta in #596
• Refactor prod configuration by @orelgueta in #599
• Minor telescope positions updates by @GernotMaier in #601
• Bump docker/setup-buildx-action from 2 to 3 by @dependabot in #607
• Bump docker/metadata-action from 4 to 5 by @dependabot in #606
• Bump docker/setup-qemu-action from 2 to 3 by @dependabot in #608
• Bump docker/login-action from 2 to 3 by @dependabot in #610
• Bump docker/build-push-action from 4 to 5 by @dependabot in #609
• Update Ubuntu version to 23.04 by @GernotMaier in #603
• Remove Apple silicon command and duplicated line by @orelgueta in #614
• Fix pack grid output by @orelgueta in #615
• Strip comments from env by @GernotMaier in #611
• Remove wrong try..except in configurator::_fill_from_environmental_variables by @GernotMaier in #612
• Remove CORSIKA source code from docker image by @GernotMaier in #616
• Address issues with pyflakes and use flake8 instead by @GernotMaier in #618
• Run remove CORSIKA code in separate RUN command by @GernotMaier in #617
• Push also on scheduled build by @orelgueta in #602
• Ensure float64 for coordinate transformations, improved coordinate transformations by @GernotMaier in #619
• Ensure latitude calculation required for local coordinate calculation by @GernotMaier in #624
• Feature camera efficiency test by @tobiaskleiner in #630
• Add Tobias as author by @GernotMaier in #632
• Layout array simplify try and except by @VictorBarbosaMartins in #631
• Add legend handlers and colours for HESS/MAGIC/VERTIAS by @orelgueta in #629
• Documentation update (mostly to the developer section) by @GernotMaier in #622
• Introduce more telescope classes and improve handling of corsika telescope height by @GernotMaier in #625
• Explicitely mention application.rst by @GernotMaier in #635
• This is a tiny PR correcting some very minor typos by @GernotMaier in #636
• Fix label corsika histograms by @VictorBarbosaMartins in #638
• Switch to alma container by @orelgueta in #639
• change to if self.combined_hists is None: by @VictorBarbosaMartins in #650
• Plot simtel histograms missing file lists by @VictorBarbosaMartins in #651
• Improve plot simtel histograms by @VictorBarbosaMartins in #655
• add punch acknowledgement by @GernotMaier in #659
• more info printed to logger in plot_simtel_histograms by @VictorBarbosaMartins in #662
• remove unused variable - nano PR by @GernotMaier in #666
• Fix deployment of github pages by @GernotMaier in #669
• check for non-ascii characters in docs by @GernotMaier in #671
• Hdf5 simtel histograms by @VictorBarbosaMartins in #664
• Improve documentation and add hints for sphinx formatting by @GernotMaier in #673
• Fix link in readme by @GernotMaier in #675
• Improve startup time of applications by @GernotMaier in #682
• Metadata code refactoring by @GernotMaier in #679
• Change codecov from master to main by @GernotMaier in #585
• Remove duplications in application default arguments printing by @GernotMaier in #689
• Improved metadata filling and validation of output by @GernotMaier in #691
• Any pull requests should trigger CI tests by @GernotMaier in #692
• Pre commit flake8 options by @GernotMaier in #688
• Layout array renaming by @GernotMaier in #672
• Use dev container for integration tests by @GernotMaier in #687
• Fix fixture interdependence in test_corsika_config by @GernotMaier in #700
• Updated documentations with steps required when adding an application by @GernotMaier in #693
• Address warnings occuring during pytest by @GernotMaier in #695
• Consistent naming of test directories - io to io_operations by @GernotMaier in #698
• Fix docstring issues leading to sphinx errors in generate_corsika_histograms by @GernotMaier in #697
• Fix intendation in documenation to generate_corsika_histograms by @GernotMaier in #702
• Improve and simplify reading and writing of tools on the example of print_array_elements by @GernotMaier in #683
• Fixes motivated by extensive linting by @GernotMaier in #690
• Solve inconsistencies in python versions - use everwhere the same python version by @GernotMaier in #699
• Increase unit test coverage for simtools/configuration/configurator.py by @GernotMaier in #707
• Improve startup time of pytest by optimising imports by @GernotMaier in #712
• Review of general.py by @GernotMaier in #704
• Pass corsika_parameters_file to CorsikaConfig in corsika_runner by @orelgueta in #714
• Linter updates by @GernotMaier in #684
• Allow specifying an external nsb spectrum for the camera efficiency application by @orelgueta in #656
• Add validation of ecsv file using a schema to application validate_file_using_schema by @GernotMaier in #716
• Add pylint to pre-commit by @GernotMaier in #720
• Configure applications from configuration file by @GernotMaier in #719
• Add pytest-random-order to development environment. by @GernotMaier in #721
• Precommit by @VictorBarbosaMartins in #725
• Add codecov configuration file to suppress failed tests when coverage falls by 0.1% by @GernotMaier in #734
• pyproject.tom formatting and pre-commit hook by @GernotMaier in #729
• Bump actions/setup-python from 4 to 5 by @dependabot in #737
• Improved handling of non-initialized IOHandler by @GernotMaier in #732
• Random state set to none by @orelgueta in #736
• remove unused functions from simulator by @VictorBarbosaMartins in #731
• Remove TODOs and FIXMEs by @orelgueta in #739
• Set explicitly output path for simulate_prod by @GernotMaier in #730
• Add skip_output_validation flag to allow writing without validation against a schema file. by @GernotMaier in #727
• Zero padding corsika output file by @orelgueta in #735
• Switch Current to released by @orelgueta in #740
• Rename coordinate system from incorrect CORSIKA to Ground coordinates; increase test coverage by @GernotMaier in #733
• Add mirror shape diameter to db by @orelgueta in #742
• Implementation of application tests using configuration files by @GernotMaier in #726
• Increase speed of simtel histograms test by @VictorBarbosaMartins in #744
• Faster integration tests by @orelgueta in #746
• Add tests of simtools-prod containers by @GernotMaier in #713
• Test --help and --version in integration tests by @GernotMaier in #745
• Old production tool real test by @VictorBarbosaMartins in #747
• Bump actions/upload-artifact from 3 to 4 by @dependabot in #748
• Remove uploading of code coverage report (XML) format as artefact by @GernotMaier in #749
• Docker images for simtools-dev and simtools-prod should not be pushed on "pull request" by @GernotMaier in #751
• Metaschema updates by @GernotMaier in #750
• Set branch for simtools-prod testing by @GernotMaier in #756
• Remove workflow dispatch for docker push by @GernotMaier in #758
• Revert push to main by @GernotMaier in #762
• Simtel histogram operations by @VictorBarbosaMartins in #754
• Reading of metadata from table header; validation of input data; introduction of data_reader by @GernotMaier in #752
• Addition of data type check to schema validation by @GernotMaier in #757
• Add json reader by @GernotMaier in #763
• Remove collect_dict_from_file function from general.py; Rename collect_data_from_yaml_or_dict by @GernotMaier in #765
• Fix push to package registry for merge to main by @GernotMaier in #766
• Add yaml to extensions by @orelgueta in #770
• Default CORSIKA simulation config class by @orelgueta in #771
• Reading of metadata from json by @GernotMaier in #767
• Simplify usage of simtools-validate-file-using-schema by @GernotMaier in #769
• Add read_value_from_file to all by @GernotMaier in #774
• Remove unused set_mongo_db_config function by @GernotMaier in #772
• Schema is now available in main branch by @GernotMaier in #779
• Change to use setters by @orelgueta in #775
• Improve configuration of make_regular_arrays by @GernotMaier in #777
• Add simulation_software:parameter_name to schema by @GernotMaier in #778
• Remove str in make_regular array on output_file by @GernotMaier in #780
• Read mirror list from ecsv by @tobiaskleiner in #718
• Add coverage to gitignore by @tobiaskleiner in #783
• add test for InconsistentHistogramFormat (and change combined_hists) by @VictorBarbosaMartins in #782
• Fix warnings by @VictorBarbosaMartins in #785
• Bug fix in mercator coordinator transformation by @GernotMaier in #786
• Add CONTEXT:NOTES to metadata by @GernotMaier in #787
• Add CONTEXT:NOTES to test file for metadata; rename test file altitude.json by @GernotMaier in #788
• Add a function that returns all telescope names available in the DB by @orelgueta in #790

New Contributors

• @tobiaskleiner made their first contribution in #630

Full Changelog: v0.5.1...v0.6.0