[ET-VK] 1/n Split dispatches between multiple command buffers. Add semaphore support in command buffer.

[trivedivivek]

Stack from ghstack (oldest at bottom):

• [ET-VK] 7/n Split dispatches between multiple command buffers. Split execute dispatch into multiple commands based on dispatch count. #12530
• [ET-VK] 6/n Split dispatches between multiple command buffers. Repurpose submit_current_cmd_and_wait to wait based on input flag. #12529
• [ET-VK] 5/n Split dispatches between multiple command buffers. Track previously submitted command buffers in context and add function to execute all previous command buffers. #12527
• [ET-VK] 4/n Split dispatches between multiple command buffers. Removing flush function call from submit_current_cmd_and_wait. #12525
• [ET-VK] 3/n Split dispatches between multiple command buffers. Track previous semaphore in context. #12523
• [ET-VK] 2/n Split dispatches between multiple command buffers. Add semaphore support to Adapter::submit_cmd. #12522
• -> [ET-VK] 1/n Split dispatches between multiple command buffers. Add semaphore support in command buffer. #12519
• [ET-VK][ez] Rename run_prepack() to prepack() and replace encode_prepack() + prepack() with just prepack() #12443
• [ET-VK] Split up prepack command buffer #12442

execute stage

Context

This following diffs aims to improve the performance of the Executorch Vulkan backend by adding a mechanism to issue multiple command buffers in prepack and execute function, so GPU work is issues while CPU is still working on issuing new work.

This Diff

Summary

This diff is the first in a series of diffs that aim to split dispatches between multiple command buffers and add semaphore support in the command buffer.

The changes in this diff include:

• Adding a VkSemaphore parameter to the CommandBuffer constructor in vk_api/Command.cpp and vk_api/Command.h to support signaling when the command buffer has completed execution.
• Modifying the CommandBuffer constructor in vk_api/Command.h and vk_api/Command.cpp to include the VkSemaphore parameter.
• Updating the CommandBuffer object in api/Context.cpp to include the VkSemaphore parameter.

Differential Revision: D78282194

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12519

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 95637b1 with merge base 46ca782 ():

NEW FAILURE - The following job has failed:

• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t aefcb797ea6ed65cf0318b56e2b1d72c3cda119434a72c730463e23bbb0a7738 /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D78282194

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D78282194