Skip to content

Commit 2d98747

Browse files
committed
add debug info
Signed-off-by: bhsueh <[email protected]>
1 parent e1dcdc5 commit 2d98747

File tree

2 files changed

+2
-1
lines changed

2 files changed

+2
-1
lines changed

tests/integration/defs/accuracy/accuracy_core.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -297,7 +297,7 @@ class GSM8K(AccuracyTask):
297297
ALPHA = 0.05
298298
BETA = 0.2
299299
SIGMA = 50
300-
NUM_SAMPLES = 1319 # Full sample
300+
NUM_SAMPLES = 2 # Full sample
301301

302302
MAX_INPUT_LEN = 4096
303303
MAX_OUTPUT_LEN = 256

tests/integration/defs/accuracy/test_llm_api_pytorch.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2312,6 +2312,7 @@ def test_nvfp4(
23122312
# task.evaluate(llm)
23132313
task = GSM8K(self.MODEL_NAME)
23142314
task.evaluate(llm)
2315+
assert False
23152316

23162317
def test_eagle3(self):
23172318
pytorch_config = dict(

0 commit comments

Comments
 (0)