Skip to content

[port, core] Open compiled model as file stream when MMAP disabled. #31813

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
praasz merged 1 commit into from
Aug 20, 2025
Merged

[port, core] Open compiled model as file stream when MMAP disabled. #31813

praasz merged 1 commit into from
Aug 20, 2025

Conversation

@praasz
Copy link
Contributor

@praasz praasz commented Aug 20, 2025

Details:

  • When MMAP feature disabled open model from cache as stream and don't read into tensor on core level. This read may trigger additional consumption as plugin may try read stream again.

Port of:

Tickets:

@praasz praasz added this to the 2025.3 milestone Aug 20, 2025
@praasz praasz requested review from a team as code owners August 20, 2025 10:36
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: CPU OpenVINO CPU plugin category: TEMPLATE OpenVINO Template plugin labels Aug 20, 2025
@moslex moslex added the priority: high High piority label Aug 20, 2025
@praasz praasz enabled auto-merge August 20, 2025 13:44
@praasz praasz added this pull request to the merge queue Aug 20, 2025
Merged via the queue into openvinotoolkit:releases/2025/3 with commit 94398ee Aug 20, 2025
211 checks passed
@praasz praasz deleted the port/bug-peak-memory-use-if-mmap-disabled branch August 20, 2025 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@olpipi olpipi olpipi approved these changes

Assignees

No one assigned

Labels

category: CPU OpenVINO CPU plugin category: inference OpenVINO Runtime library - Inference category: TEMPLATE OpenVINO Template plugin Code Freeze priority: high High piority

Projects

None yet

Milestone

2025.3

Development

Successfully merging this pull request may close these issues.

3 participants

@praasz @olpipi @moslex