Skip to content

Conversation

ericcraw
Copy link

@ericcraw ericcraw commented Oct 10, 2025

Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces memory mapping functionality for shared weights in the OpenVINO execution provider to improve performance by avoiding unnecessary memory copies. The changes enable direct memory mapping of external weight files to device tensors when possible.

  • Added version check macro for OpenVINO to conditionally enable features based on version
  • Implemented memory mapping support for weight files with device-specific optimizations
  • Refactored tensor creation to use memory-mapped weights when available, falling back to traditional copying

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
onnxruntime/core/providers/openvino/ov_interface.h Added version check macro for OpenVINO compatibility
onnxruntime/core/providers/openvino/contexts.h Extended WeightsFile class with device mapping functionality
onnxruntime/core/providers/openvino/backend_utils.cc Implemented memory mapping logic and refactored tensor creation

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants