ReFrame 4.1.3

Release Notes

Bug fixes

• Fix test selection in Gitlab child pipelines (#2856)
• Fix log record attribute names of performance thresholds (#2852)

ReFrame 4.1.2

Release Notes

Enhancements

• Improve help message of --detect-host-topology option (#2835)
• Add a .readthedocs.yaml for generating the docs (#2829)

Other

• Use ghcr.io to retrieve CI images (#2831)

ReFrame 4.1.1

Release Notes

Enhancements

• Include log files in the run report (#2828)
• Add a note about sched_options being broken in 4.0 (#2827)
• Provide further documentation about the pipeline_timeout attribute (#2816)
• Fix typo in make_test docs (#2817)

Bug fixes

• Allow proper assignment of time_limit from command line (#2823)

Test library

• Set executable_opts of GPU burn test in a pre-run hook (#2826)

ReFrame 4.1.0

Release Notes

Changes since 4.0.5

New features

• Introduce a --dry-run option (#2746)
• Allow num_tasks to be None (#2778)
• Allow custom JSON formatting for log records in the httpjson handler (#2752)
• Print the first lines of stderr and stdout in case of sanity failures (#2762)
• Relax the regex matching for test names and tags (#2736)

Enhancements

• Properly combine append-type command-line options defined in execution modes (#2788)

Bug fixes

• Fix listing of non-fixture-based dependencies (#2798)
• Fix use of sched_options by the backend schedulers (#2796)

Other

• Update GitHub Actions to use setup-python@v4 (#2775)

ReFrame 4.0.5

Release Notes

Enhancements

• Warn if an invalid mode option is passed to --mode (#2790)
• Print the fixture variable names in test listings (#2783)

Bug fixes

• Properly define sched_options in the configuration schema (#2793)
• Do not issue a name conflict error for the same fixture imported from different test files (#2780)
• Register performance functions even if perf_variables are defined in the class body and improve the performance function docs (#2770)
• Correctly silence the stream handlers only when the -q option is passed (#2786)

Other

• Use release/v1 version for the publish Github action (#2791)
• Improve the release notes generation (#2782)

ReFrame 4.0.4

Release Notes

Bug fixes

• Warn for unset variables only for the tests that are selected (#2774)

Test library

• Update the syntax of the ipcmagic hpclib test to match ipcmagic-1.1.0 (#2777)

ReFrame 4.0.3

Release Notes

New features and enhancements

n/a

Bug fixes

• Fix confusing stack trace dump when a logging error occurs (#2769)
• Pass long job options with = (#2766)
• Fix broken --cpu-only and --gpu-only options (#2765)
• Fix performance logging when perf_variables are set in a performance stage hook (#2751)

Test library

• Change execution stage in OSU test library (#2767)

Other

• Use master branch for deployment (#2750)

ReFrame 4.0.2

Release Notes

New features and enhancements

n/a

Bug fixes

• Add MANIFEST.in to include the README_minimal.md (#2731)

Test library

n/a

Other

• Improve documentation for the RFM_CONFIG_PATH (#2743)

ReFrame 4.0.1

Release Notes

Bug fixes

• Fix perflog_compat crash when performance test fails in sanity (#2718)

ReFrame 4.0.0

Release Notes

Changes since version 3.12.0.

New features and enhancements

• Remove the --strict option (#2711)
• Remove the --force-local option (#2710)
• Control verbosity level of the immediate performance info (#2695)
• Remove the schedulers section from the configuration (#2694)
• Remove deprecated --ignore-check-conflicts CLI option and the associated configuration option (#2706)
• Update temp_environment to use env_vars as an argument (#2707)
• Improve performance logging (#2633)
• Print better error message when pygelf cannot be imported (#2691)
• Build configuration incrementally by allowing to combine multiple configuration files (#2557)
• Relax the value syntax of env_vars (#2649)
• Deprecate variables in favour of the new env_vars (#2648)
• Introduce variable aliases (#2647)
• Change default value of num_gpus_per_node to None (#2638)
• Extend functionality to get the Cray's CDT version to support systems based on the CPE module (#2644)
• Allow tests to require references (#2627)
• Remove the deprecated RFM_GRAYLOG_SERVER environment variable (#2624)
• Improve framework messages and the performance report (#2618)
• Add perflog_ignore attribute in httpjson handler (#2620)
• Allow user defined launchers in the configuration (#2605)
• Add support for the Apptainer container platform (#2613)
• Add support for the Flux scheduler (#2598)
• Stop execution with an error when a cli module fails to load (#2603)
• Revert to generating unique run reports (#2601)
• Change default hostname autodetection parameters (#2583)
• Associate a unique hash with each test (#2578)
• Add command line option to set the execution order of independent tests (#2575)
• Drop the old test naming scheme (#2574)
• Introduce ReFrame 4.0 (#2562)
• Use the test's extra_resources also for the build job (#2547)
• Remove deprecated features for 4.x (#2096)
• Remove deprecated features from 4.x (#1986)
• Drop the @parameterized_test decorator (#1951)

Bug fixes

• Fix cleanup crash for non-performance tests when the perflog_compat option is on (#2716)
• Fix hash clashes for parameterised tests (#2714)
• Restrict reference tuples acceptable types (#2702)
• Properly set display name of tests with join fixtures (#2705)
• Do not require handlers$ in the logging config (#2692)
• Fix nodelist compaction for single digitless nodes (#2689)
• Fix filtering of tests with hashcode (#2688)
• Fix variable assignment when aliases are set in subclasses (#2683)
• Fix injection of env variables for non default craype (#2682)
• Pass explicitly the --cpus-per-task option to srun for Slurm >= 22.05 (#2656)
• Expand the Slurm nodelist using scontrol and not the builtin nodelist_expand() function (#2678)
• Keep updating the node list during the job (#2634)
• Filter out unnecessary fixtures when listing or running tests (#2641)
• Submit jobs using the correct module path when testing scheduler backends (#2611)
• Document missing log record attributes (#2586)
• Log correctly %(check_perfvalues)s attribute (#2588)
• Fix singularity cli option to change to the mounted stage directory with the Singularity container platform (#2581)

Test library

• Use the builtin validation option of OSU benchmarks to validate the results (#2679)

Other

• Use an Ubuntu 20.04 image for Python 3.6 tests (#2712)
• Add support for Python 3.11 and update CI workflow for Python 3.6 (#2703)
• Revert workaround in script for generating release notes (#2680)
• Fix script that auto-generates the release notes (#2594)
• Add a "What's New" page for ReFrame 4.0 (#2709)
• Document the rest of Job's properties (#2713)
• Update link in codecov badge (#2708)
• Fix example in sn.print() docs (#2685)
• Update copyright notice in docs (#2684)
• Remove mailing list from README (#2643)
• Adapt README for dark and light Github modes (#2608)
• Fix typo on the docs (#2599)
• Fix broken links in the docs (#2593)
• Fix documentation of modules test attribute (#2592)
• Add a warning in documentation about the usage of perf_patterns (#2587)
• Add CSCS webinar resources + links (#2582)
• Fix example of httpjson handler usage (#2563)
• Add note about test dependencies in --repeat option docs (#2564)