Search results

[WIP] Rpc split row

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 16020

#16020 In ggml-org/llama.cpp;

· LeaveNhA opened on Sep 16, 2025

<code>--numa mirror</code>: mirror model weights to every Numa node in the system

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

IBM zDNNissues specific to IBM zDNN Acceleratorissues specific to IBM zDNN Accelerator

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

pythonpython script changespython script changes

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 16000

#16000 In ggml-org/llama.cpp;

· dbsanfte opened on Sep 15, 2025

metal : refactor + optimize v2

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 15995

#15995 In ggml-org/llama.cpp;

· ggerganov opened on Sep 14, 2025

metal : use virtual GPU address for private buffers

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Draft (not ready).

ggml-org/llama.cppnumber 15985

#15985 In ggml-org/llama.cpp;

· ggerganov opened on Sep 14, 2025

ggml : fix padding in timestep embedding kernels

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 15932

#15932 In ggml-org/llama.cpp;

· danbev opened on Sep 11, 2025

metal : reuse graphs

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

demoDemonstrate some concept or idea, not intended to be mergedDemonstrate some concept or idea, not intended to be merged

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Draft (not ready).

ggml-org/llama.cppnumber 14570

#14570 In ggml-org/llama.cpp;

· ggerganov opened on Jul 7, 2025

llama : try loading tensors with pre-computed hashes

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Komputehttps://github.com/KomputeProject/kompute/https://github.com/KomputeProject/kompute/

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 13106

#13106 In ggml-org/llama.cpp;

· rgerganov opened on Apr 25, 2025

Metal TQ2_0

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 12485

#12485 In ggml-org/llama.cpp;

· dmahurin opened on Mar 20, 2025

<code>tool-call</code>: Phi-4 support

androidIssues specific to AndroidIssues specific to Android

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

server

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 12288

#12288 In ggml-org/llama.cpp;

· jpohhhh opened on Mar 9, 2025

ggml-cuda : add TQ2_0 kernels, for ternary inference on GPU

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

enhancementNew feature or requestNew feature or request

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

performanceSpeed related topicsSpeed related topics

pythonpython script changespython script changes

Review Complexity : HighGenerally require indepth knowledge of LLMs or GPUsGenerally require indepth knowledge of LLMs or GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 11183

#11183 In ggml-org/llama.cpp;

· compilade opened on Jan 10, 2025

Add VisionOS compatibility by adding missing type definitions

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 11019

#11019 In ggml-org/llama.cpp;

· sinkingsugar opened on Dec 30, 2024

Research: Performance differences between Metal (macOS) and Vulkan (Linux)

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

research 🔬

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open.

#10982 In ggml-org/llama.cpp;

· asahilina opened on Dec 26, 2024