Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ovep develop 1.21 #22824

Merged
merged 25 commits into from
Nov 15, 2024
Merged

Ovep develop 1.21 #22824

merged 25 commits into from
Nov 15, 2024
+77 −40

Conversation

preetha-intel
Copy link
Contributor

Description

OVEP development changes for ORT 1.21 Release

Motivation and Context

Has critical bug fixes
Support for concurrency execution of models is enabled
Support for OV 2024.5
Memory optimizations for NPU platform

jatinwadhwa921 and others added 24 commits October 23, 2024 06:44
@jatinwadhwa921 @TejalKhade28
Add check for NPU device type in allocator creation logic
0c4f811
@ankitm3k
Merge pull request #478 from intel/jatin_remote_tensor_fix
e22302e 
Add check for NPU device type in allocator creation logic
@ankitm3k
update: Upgraded to OpenVINO v2024.5
3e1c4eb
@sfatimar
Merge branch 'microsoft:main' into ovep-develop-lnl-1.4
559e04f
@saurabhkale17
enable initializer dtype
112988b
@sfatimar
Merge pull request #483 from intel/saurabh/enable_initializer
7a52822 
add initializer data type support
@preetha-intel
Create multi infer requests in OVEP based on num_threads
ac29ec7
@sfatimar
Merge branch 'microsoft:main' into ovep-develop-lnl-1.4
cbd5fc2
@sfatimar
Merge pull request #485 from intel/concurrency_fix
ab7807f 
Create multi infer requests in OVEP based on num_threads
@TejalKhade28
Updated API Documentation with required comments
0373154
@sfatimar
Merge pull request #480 from intel/ankit/upgrade_openvino_tookit
4e69ff5 
update: Upgraded to OpenVINO v2024.5
@sfatimar
Merge branch 'microsoft:main' into ovep-develop-lnl-1.4
bc9cb42
@ankitm3k
update: Extend datatypes support
d6bdd1f
@sfatimar
Merge pull request #482 from intel/ankit/extend_dtype_support
2c27729 
update: Extend datatypes support
@sfatimar
Merge pull request #490 from intel/update_doc_1.4
2e89c6c 
Updated API Documentation with required comments
@preetha-intel
Add support for dynamic workload type (#489)
ddd84c7 
* Add support for dynmaic workload type

* Fix the iteration on gsl::span dynamic keys and values

* Fix lint issues
@javier-intel
Fix inference with EP context embed mode 0
f1b1ed4
@sfatimar
Merge pull request #491 from intel/fix_infer_epctx_embed_0
28ce96e 
Fix inference with EP context embed mode 0
@javier-intel
Allow OVEP to use OV packages built only with RelWithDebInfo
ae96e3f
@preetha-intel
Merge branch 'master' into ovep-develop-lnl-1.4
946552c
@jatinwadhwa921
Upgrade OVEP CI to 2024.4.0
eb3ddc0
@sfatimar
Merge pull request #497 from intel/jatin_wadhwa_upgarde_ovep_ci_2024.4
90849fa 
Upgrade OVEP CI to 2024.4.0
@sfatimar
Merge branch 'microsoft:main' into ovep-develop-lnl-1.4
7b5499b
@preetha-intel
Fix lint warnings
036e2b8
@preetha-intel preetha-intel requested a review from a team as a code owner November 13, 2024 17:21
@jywu-msft
Copy link
Member

/azp run Linux OpenVINO CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@sfatimar
Copy link
Contributor

@adrianlizarraga @jywu-msft Please review

@jywu-msft
Copy link
Member

please fix lintrunner error https://github.com/microsoft/onnxruntime/actions/runs/11822465741/job/32940502475?pr=22824

@preetha-intel
Copy link
Contributor Author

@jywu-msft Added the fix for pylint failure. Can you please retrigger the pipelines. Thanks

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

/azp run Windows CPU CI Pipeline, Windows GPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows ARM64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline, Windows x64 QNN CI Pipeline, Linux MIGraphX CI Pipeline, Big Models

@jywu-msft
Copy link
Member

/azp run Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 6 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@jywu-msft jywu-msft merged commit ac9c135 into microsoft:main Nov 15, 2024
78 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jywu-msft jywu-msft jywu-msft approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@preetha-intel @jywu-msft @sfatimar @jatinwadhwa921 @ankitm3k @saurabhkale17 @TejalKhade28 @javier-intel