Updated results summary [skip ci]

mlcommons-bot · mlcommons-bot · commit 15a0516ebe62 · 2025-10-23T09:33:49.000Z
diff --git a/README.md b/README.md
@@ -1,21 +1,21 @@
 Please download [summary.xlsx](summary.xlsx) to view the most recent results. 
  ```
-[2025-10-21 02:26:43,291 submission_checker1.py:3492 INFO] Results=37, NoResults=0, Power Results=0
-[2025-10-21 02:26:43,291 submission_checker1.py:3499 INFO] ---
-[2025-10-21 02:26:43,291 submission_checker1.py:3500 INFO] Closed Results=0, Closed Power Results=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3492 INFO] Results=37, NoResults=0, Power Results=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3499 INFO] ---
+[2025-10-23 09:33:43,845 submission_checker1.py:3500 INFO] Closed Results=0, Closed Power Results=0
 
-[2025-10-21 02:26:43,291 submission_checker1.py:3505 INFO] Open Results=37, Open Power Results=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3505 INFO] Open Results=37, Open Power Results=0
 
-[2025-10-21 02:26:43,291 submission_checker1.py:3510 INFO] Network Results=0, Network Power Results=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3510 INFO] Network Results=0, Network Power Results=0
 
-[2025-10-21 02:26:43,291 submission_checker1.py:3515 INFO] ---
-[2025-10-21 02:26:43,291 submission_checker1.py:3517 INFO] Systems=30, Power Systems=0
-[2025-10-21 02:26:43,291 submission_checker1.py:3521 INFO] Closed Systems=0, Closed Power Systems=0
-[2025-10-21 02:26:43,291 submission_checker1.py:3526 INFO] Open Systems=30, Open Power Systems=0
-[2025-10-21 02:26:43,291 submission_checker1.py:3531 INFO] Network Systems=0, Network Power Systems=0
-[2025-10-21 02:26:43,291 submission_checker1.py:3536 INFO] ---
-[2025-10-21 02:26:43,291 submission_checker1.py:3541 INFO] SUMMARY: submission looks OK
-[2025-10-21 02:26:44,489 module.py:5543 INFO] -        ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
+[2025-10-23 09:33:43,845 submission_checker1.py:3515 INFO] ---
+[2025-10-23 09:33:43,845 submission_checker1.py:3517 INFO] Systems=30, Power Systems=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3521 INFO] Closed Systems=0, Closed Power Systems=0
+[2025-10-23 09:33:43,845 submission_checker1.py:3526 INFO] Open Systems=30, Open Power Systems=0
+[2025-10-23 09:33:43,846 submission_checker1.py:3531 INFO] Network Systems=0, Network Power Systems=0
+[2025-10-23 09:33:43,846 submission_checker1.py:3536 INFO] ---
+[2025-10-23 09:33:43,846 submission_checker1.py:3541 INFO] SUMMARY: submission looks OK
+[2025-10-23 09:33:45,008 module.py:5543 INFO] -        ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
 
 ```
 
@@ -30,7 +30,7 @@ Please download [summary.xlsx](summary.xlsx) to view the most recent results.
 |  6 | MLCommons      | available      | open       | edge         | gh_macos-latest_x86  | gh_macos-latest_x86-reference-cpu-pytorch_v2.6.0-default_config       | retinanet           | retinanet           | Offline    |  0.457477  | mAP: 76.951                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline       | pytorch v2.6.0      | (darwin-23.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 |  7 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config          | resnet50            | resnet              | Offline    | 21.0975    | acc: 76.000                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config/resnet50/offline           | tf v2.19.0          | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 |  8 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest_x86 | gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config      | retinanet           | retinanet           | Offline    |  0.405224  | mAP: 76.951                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline      | pytorch v2.6.0      | Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39)  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
-|  9 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config     | resnet50            | resnet              | Offline    | 23.4255    | acc: 76.000                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline      | onnxruntime         | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
+|  9 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config     | resnet50            | resnet              | Offline    | 23.1605    | acc: 76.000                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline      | onnxruntime         | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 10 | MLCommons      | available      | open       | edge         | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config     | retinanet           | retinanet           | Offline    |  0.413064  | mAP: 76.951                                                                                                           |                 1 | AMD EPYC 7763 64-Core Processor |                          1 |                           2 | nan                      |                       0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline     | onnxruntime         | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 11 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config  | resnet50            | resnet              | Offline    | 19.7056    | acc: 76.000                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/resnet50/offline   | onnxruntime v1.21.0 | (darwin-23.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
 | 12 | MLCommons      | available      | open       | edge         | gh_macos-latest x86  | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config  | retinanet           | retinanet           | Offline    |  0.384271  | mAP: 76.951                                                                                                           |                 1 | undefined                       |                          1 |                           3 | nan                      |                       0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/retinanet/offline  | onnxruntime v1.21.0 | (darwin-23.6.0)                                  |     nan |            1 |        0 | v5.0      |          0 | False       | Samples/s | fp32                |
diff --git a/dbversion b/dbversion
@@ -1 +1 @@
-1604
+1605
diff --git a/summary.csv b/summary.csv
@@ -8,7 +8,7 @@ MLCommons,available,open,"edge","gh_ubuntu-latest",gh_ubuntu-latest-reference-cp
 MLCommons,available,open,"edge","gh_macos-latest_x86",gh_macos-latest_x86-reference-cpu-pytorch_v2.6.0-default_config,retinanet,retinanet,Offline,0.457477,mAP: 76.951,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline,"pytorch v2.6.0"," (darwin-23.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config,resnet50,resnet,Offline,21.0975,acc: 76.000,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config/resnet50/offline,"tf v2.19.0","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest_x86",gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config,retinanet,retinanet,Offline,0.405224,mAP: 76.951,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.6.0-default_config/retinanet/offline,"pytorch v2.6.0","Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
-MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,resnet50,resnet,Offline,23.4255,acc: 76.000,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline,"onnxruntime","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
+MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,resnet50,resnet,Offline,23.1605,acc: 76.000,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline,"onnxruntime","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_ubuntu-latest x86",gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config,retinanet,retinanet,Offline,0.413064,mAP: 76.951,1,"AMD EPYC 7763 64-Core Processor",1,2,"N/A","0",open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline,"onnxruntime","Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config,resnet50,resnet,Offline,19.7056,acc: 76.000,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/resnet50/offline,"onnxruntime v1.21.0"," (darwin-23.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
 MLCommons,available,open,"edge","gh_macos-latest x86",gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config,retinanet,retinanet,Offline,0.384271,mAP: 76.951,1,"undefined",1,3,"N/A","0",open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/retinanet/offline,"onnxruntime v1.21.0"," (darwin-23.6.0)","",1,0,v5.0,0,False,Samples/s,"fp32"
diff --git a/summary.json b/summary.json
@@ -279,7 +279,7 @@
         "Model":"resnet50",
         "MlperfModel":"resnet",
         "Scenario":"Offline",
-        "Result":23.4255,
+        "Result":23.1605,
         "Accuracy":"acc: 76.000",
         "number_of_nodes":1,
         "host_processor_model_name":"AMD EPYC 7763 64-Core Processor",
diff --git a/summary.xlsx b/summary.xlsx
diff --git a/summary_results.json b/summary_results.json
@@ -716,7 +716,7 @@
     "Code": "https://github.com/mlcommons/mlperf_inference_test_submissions_v5.0/tree/main/open/MLCommons/code",
     "Unique ID (e.g. for Audit)": "edge/open/MLCommons/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50",
     "ColorKey": "availableMLCommons",
-    "Performance_Result": 23.4255,
+    "Performance_Result": 23.1605,
     "Performance_Units": "Samples/s"
   },
   {

Original file line number	Diff line number	Diff line change
`@@ -716,7 +716,7 @@`
`716`	`716`	`"Code": "https://github.com/mlcommons/mlperf_inference_test_submissions_v5.0/tree/main/open/MLCommons/code",`
`717`	`717`	`"Unique ID (e.g. for Audit)": "edge/open/MLCommons/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50",`
`718`	`718`	`"ColorKey": "availableMLCommons",`
`719`		`- "Performance_Result": 23.4255,`
	`719`	`+ "Performance_Result": 23.1605,`
`720`	`720`	`"Performance_Units": "Samples/s"`
`721`	`721`	`},`
`722`	`722`	`{`