Skip to content
This repository has been archived by the owner on Jan 3, 2023. It is now read-only.

[do not merge] Develop experimental merge to master #55

Open
wants to merge 36 commits into
base: master
Choose a base branch
from

Conversation

sfraczek
Copy link
Collaborator

This is how it would look like if we want to rebase develop on master and merge

sfraczek and others added 30 commits February 10, 2020 14:14
* fix test area_scale

* recover missing test/test_data/flowers.jpg

* add resize_short

* add resize_short

* add bgr_to_rgb

* add normalization

* added benchmark of imagenet for PaddlePaddle config

* rename normalize->standardize

* update docs

* add missing test/test_data/img_2112_70.jpg

* disable nds in tests

* review fix: make mean & stddev optional

* resize short condition moved outside

* from_to uses loop and is moved to constructor and added const

* moved check out of standardize

* Refactored standardize to make it more readable

* rephrase cmoment

* bring back optimization to mix channels if is continuous

* Deterministic shuffle images in block when reading from cache

Workaround to enable shuffle images in block when cache is turned off

* initial version

* fix bug

* fix bugs

* add unit tests

* clean up

* fix multinode shuffling bug

* fix warnings on member initializer list order

* fix bug

* add missing test.cpio

* update loader.deterministic test

* add benchmark for pure image reading in test/test_benchmark.cpp

* added cv::

* disk benchmarks

* Disable test instead of commenting them out.

* Add interpolation_method for augmentation config.

- Add interpolation parameter to image::resize function.

* Simplify condition when to mix channels.

Use passed value of image config bgr_to_rgb key.

* Add utility for reading binary files.

* Enable generating manifest file with provided set of images.

* Add UT checking for image provider augmentation and loading.

* Comment out UTs which cause compilation errors.

* Fix some errors, refactoring.

- Fix condition for not mixing channels.
- Remove `std::` prefix
- Remove where unnecessary `nervana::` prefix.
- Add `m_` prefix to `from_to` member.

* Disable test_loader.deterministic UT.

* Add missing input cpio test data.

* Add augmentation pipeline UT for validation config.

* Add reference results binary file for validation augmentation UT.

* Use interpolation method from config.

* Fix conversion to cropbox cv::Rect.
…on 2.7 (#8)

this is workaround which disables python 3 discovery because if you have more python versions then there is conflict in interp and libs versions.
…finity (#9)

add environment variable AEON_CPU_LIST controlled affinity
replaced decode thread count with cpu list
added config variable cpu_list
moved automatic core number selection to loader.cpp
updated documentation
added get_thread_affinity_map function to clean it up
fixed decode_size equation
changed constructor of thread_pool
remove memory copy in last stage if we don't use transpose
* use USE_SOX to enable audio build
* fix setup.py by Jiunn-Yeu

* remove sox from setup.py if USE_SOX=OFF
* removed audio

* more sox removal

* review fix
Add support for sanitizers
* some sanitizer fixes
* bump version
Fixed generating whl file when sanitizer is OFF
* throw exception when decoded broken file
* added error handling on further iteration
* set ptr to nullptr after deletion
* rename some NULL -> nullptr
* test/CMakeLists.txt alphabetical SRCs

* move all benchmark tests to test_benchmark.cpp

* TEST_IMAGENET_CACHE->TEST_CACHE where not using imagenet
* fixe error when ~/aeon_cache doesn't exist

* fix TEST(benchmark, manifest)

* csv->tsv more consistent renaming
* fix immediate binding hardening-check

* remove unnecessary clang centos code from setup.py

* remove discontinuation notice

* add example imagenet manifest files

* change example imagenet manifest files path

* default build type Debug->Release
* remove client-service architecture
removed python plugins
…sv (#42)

* more verbose errror message

* revert ASCII_INT to STRING in example manifest

to avoid random confusion because it has been used as STRING all the
time recently
* replace boost::filesystem with std::experimental::filesystem

* further boost removal effort
* validate depthmap image and pixelmask image

* remove wav_data
@sfraczek sfraczek requested a review from AdrShv February 10, 2020 13:17
@sfraczek sfraczek changed the title Develop experimental merge to master [do not merge] Develop experimental merge to master Feb 11, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants