Utilize GitHub Actions for building and running via QEMU #11

G36maid · 2025-07-04T02:58:42Z

Fixes #2

This PR introduces a GitHub Actions CI workflow that:

Builds the Linmo kernel using the GNU RISC-V toolchain
Runs the cpubench application under QEMU
Extracts benchmark output (e.g., Result / Elapsed Time)
Automatically comments the result on PRs via GitHub Action bot

Sample output from a successful CI run:
Preview: G36maid#1

Notes

cpubench enters preemptive mode after benchmark completion, causing it to continue running tasks indefinitely.
To ensure QEMU terminates in CI, I used a timeout 5s wrapper.
Just use this trick to avoid the ci keep running

Ongoing Work

I am currently working on a shell script runner that can test multiple applications (e.g., hello, cpubench, etc.) in sequence.
I plan to expand the workflow to support the LLVM toolchain via matrix across toolchains and apps.

This is just a prototype implementation.
Feel free to comment, suggest improvements, or advertise what kinds of test is needed.

I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job

The error_desc array and the perror pointer are never modified after initialization. Marking them as const moves the data to the read-only section, improving safety. Before: $ riscv-none-elf-size ./build/kernel/error.o text data bss dec hex filename 398 172 0 570 23a ./build/kernel/error.o After: $ riscv-none-elf-size ./build/kernel/error.o text data bss dec hex filename 570 0 0 570 23a ./build/kernel/error.o

strlen() returns the length of the input string, which is always non‑negative. Switching the return type to size_t is more accurately.

jserv

Rebase the latest main branch.

.github/workflows/ci.yml

jserv · 2025-07-04T03:10:30Z

.github/workflows/ci.yml

+          wget https://github.com/riscv-collab/riscv-gnu-toolchain/releases/download/2025.06.13/riscv32-elf-ubuntu-22.04-gcc-nightly-2025.06.13-nightly.tar.xz
+          tar -xf riscv32-elf-ubuntu-22.04-gcc-nightly-2025.06.13-nightly.tar.xz


Move to dedicated scripts. See https://github.com/sysprog21/rv32emu/tree/master/.ci for reference.

Do you prefer keeping the scripts in a .ci/ directory (as in rv32emu),
or splitting them into a more general scripts/ directory for better reuse —
for example, by developers who want to build and run the kernel locally?

Do you prefer keeping the scripts in a .ci/ directory (as in rv32emu), or splitting them into a more general scripts/ directory for better reuse — for example, by developers who want to build and run the kernel locally?

All CI-specific scripts should be placed in the .ci directory, as they are not intended for general use.

kernel/error.c

jserv · 2025-07-04T03:23:18Z

I am currently working on a shell script runner that can test multiple applications (e.g., hello, cpubench, etc.) in sequence.

cpubench might not be an ideal target for testing purposes, as it lacks interleaving and concurrent execution.

lib/libc.c

jserv

Remove lib/libc.c and do git rebase.

jserv · 2025-07-04T03:35:24Z

Next time, don't submit pull request via main (or default branch).
See https://graphite.dev/blog/pull-request-best-practices

The workflow now extracts cpubench results from QEMU output and automatically comments the result on pull requests. Improve CI workflow with QEMU, cpubench, timeout I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job Fix merge conflict markers in CI workflow file Use Ubuntu 24.04 in CI workflow Remove merge conflict markers from error.c Remove merge conflict markers from error.h Remove redundant libc.h include from libc.c Delete libc.c

G36maid · 2025-07-04T03:41:34Z

Next time, don't submit pull request via main (or default branch). See https://graphite.dev/blog/pull-request-best-practices

Got it.

G36maid · 2025-07-04T03:43:00Z

Marking this PR as a draft while I work on extracting the scripts from the workflow.

Will reopen this PR or open a new one once the improvements are complete.

G36maid · 2025-07-04T09:32:01Z

A new PR is open #12

Fixes #2 Improves upon PR sysprog21#11 - Build Linmo kernel using RISC-V GNU toolchain - Run selected apps (e.g., cpubench) inside QEMU - Auto-extract test output and post results as PR comments - Move toolchain setup, build, and QEMU run logic to `.ci/` scripts - Introduce flexible script-based test sequencing and suite support - Improve CI maintainability and transparency for contributors Limitations: - Current tests (like cpubench) are not designed for full regression testing - Preemptive mode may stop QEMU exit - Only supports GNU toolchain for now; LLVM support WIP

This commit introduces a GitHub Actions workflow to build the Linmo kernel using the GNU RISC-V toolchain and run selected applications (e.g., cpubench) using QEMU. Test output is extracted from QEMU logs and automatically posted as a comment to pull requests. Toolchain setup, kernel build, and QEMU test execution have been modularized into reusable scripts under the `.ci/` directory. Features: - CI supports running multiple apps in a single job - All QEMU runs are time-limited to prevent hangs - Results are reported directly to GitHub PRs Limitations: - Only GNU toolchain is supported (LLVM is a work in progress) - Some test apps (e.g., cpubench) do not exit cleanly due to entering preemptive scheduler mode Fixes: #2 Supersedes: sysprog21#11

Introduce GitHub Actions-based CI that builds the kernel using the GNU RISC-V toolchain and runs selected apps (e.g., cpubench) in QEMU. Results are extracted and posted to PRs. Toolchain setup, build, and QEMU test logic are modularized into scripts in .ci/. Features: - Support multiple apps per run - CI comments results on PR automatically - Timeout prevents hangs Limitations: - Currently GNU-only (LLVM WIP) - cpubench doesn't exit cleanly due to preemptive mode Fixes: #2 Supersedes: sysprog21#11

This commit introduces initial support for compiling the RISC-V target using the LLVM toolchain. Add CI workflow to build and test with QEMU Introduce GitHub Actions-based CI that builds the kernel using the GNU RISC-V toolchain and runs selected apps (e.g., cpubench) in QEMU. Results are extracted and posted to PRs. Toolchain setup, build, and QEMU test logic are modularized into scripts in .ci/. Features: - Support multiple apps per run - CI comments results on PR automatically - Timeout prevents hangs Limitations: - Currently GNU-only (LLVM WIP) - cpubench doesn't exit cleanly due to preemptive mode Fixes: #2 Supersedes: sysprog21#11 Refactor riscv build.mk toolchain selection logic Add CI workflow for building and testing Improve CI workflow with QEMU, cpubench, timeout I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job ci: refactor QEMU test workflow and extract scripts The workflow now extracts cpubench results from QEMU output and automatically comments the result on pull requests. Improve CI workflow with QEMU, cpubench, timeout I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job Fix merge conflict markers in CI workflow file Use Ubuntu 24.04 in CI workflow Remove merge conflict markers from error.c Remove merge conflict markers from error.h Remove redundant libc.h include from libc.c Delete libc.c Add CI scripts and refactor workflow - Move toolchain setup, build, QEMU run, and result extraction to dedicated scripts in .ci/ - Update ci.yml to use these scripts for improved maintainability Make CI scripts executable Add flexible test sequencing and CI test suites - Replace run-qemu.sh with run-test-sequence.sh for configurable, robust test execution (supports timeouts, app lists, output dirs, continue-on-failure, and verbosity) - Add run-qemu-tests.sh for simple sequential app testing - Add test suite definitions: basic.txt, performance.txt, comprehensive.txt - Overhaul extract-result.sh to aggregate, summarize, and format results for GitHub Actions and artifacts - Update CI workflow to run multiple test suites (basic, performance, comprehensive, custom), upload artifacts, and generate a consolidated summary - Remove obsolete run-qemu.sh script Simplify CI test runner and result extraction Comment PR with benchmark results in CI workflow Run all basic apps in CI and comment results on PRs Remove extract-result.sh and update CI to inline test output Update QEMU tests to run cpubench and test64 only Inline build steps in CI workflow and remove build.sh

This commit introduces initial support for compiling the RISC-V target using the LLVM toolchain. Add CI workflow to build and test with QEMU Introduce GitHub Actions-based CI that builds the kernel using the GNU RISC-V toolchain and runs selected apps (e.g., cpubench) in QEMU. Results are extracted and posted to PRs. Toolchain setup, build, and QEMU test logic are modularized into scripts in .ci/. Features: - Support multiple apps per run - CI comments results on PR automatically - Timeout prevents hangs Limitations: - Currently GNU-only (LLVM WIP) - cpubench doesn't exit cleanly due to preemptive mode Fixes: #2 Supersedes: sysprog21#11 Refactor riscv build.mk toolchain selection logic Add CI workflow for building and testing Improve CI workflow with QEMU, cpubench, timeout I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job ci: refactor QEMU test workflow and extract scripts The workflow now extracts cpubench results from QEMU output and automatically comments the result on pull requests. Improve CI workflow with QEMU, cpubench, timeout I notice that the cpu bench will make qemu into Scheduler mode: Preemptive so the qemu will not stop, add some trick to pass the test(not good) Refactor CI workflow for improved toolchain usage Comment out hello build and run step in CI workflow Update RISC-V toolchain and enable hello build step Add -bios none to QEMU commands in CI workflow Remove hello build and run step from CI workflow Add timeout to QEMU command in CI workflow Add completion message to cpubench CI step Allow QEMU step to pass without stopping CI job Fix merge conflict markers in CI workflow file Use Ubuntu 24.04 in CI workflow Remove merge conflict markers from error.c Remove merge conflict markers from error.h Remove redundant libc.h include from libc.c Delete libc.c Add CI scripts and refactor workflow - Move toolchain setup, build, QEMU run, and result extraction to dedicated scripts in .ci/ - Update ci.yml to use these scripts for improved maintainability Make CI scripts executable Add flexible test sequencing and CI test suites - Replace run-qemu.sh with run-test-sequence.sh for configurable, robust test execution (supports timeouts, app lists, output dirs, continue-on-failure, and verbosity) - Add run-qemu-tests.sh for simple sequential app testing - Add test suite definitions: basic.txt, performance.txt, comprehensive.txt - Overhaul extract-result.sh to aggregate, summarize, and format results for GitHub Actions and artifacts - Update CI workflow to run multiple test suites (basic, performance, comprehensive, custom), upload artifacts, and generate a consolidated summary - Remove obsolete run-qemu.sh script Simplify CI test runner and result extraction Comment PR with benchmark results in CI workflow Run all basic apps in CI and comment results on PRs Remove extract-result.sh and update CI to inline test output Update QEMU tests to run cpubench and test64 only Inline build steps in CI workflow and remove build.sh Add LLVM toolchain support to CI and build system Remove test-summary job from CI workflow Update toolchain URLs and add CI test summary job Remove test64 argument from QEMU test script in CI Refactor toolchain URLs and add LLVM fallback in CI workflow Set CROSS_COMPILE to riscv32-unknown-elf- in CI setup Add AR=llvm-ar to LLVM toolchain environment setup Refactor toolchain URL to use TOOLCHAIN_OS variable Refactor RISC-V toolchain selection and defaults Run CI on all branches and pull requests Add __maybe_unused macro for unused attribute Use GNU ar instead of llvm-ar for LLVM toolchain Update toolchain version to verified Detect Clang toolchain in RISC-V build script

This comment was marked as duplicate.

Sign in to view

jserv changed the title ~~Add GitHub Actions CI for building and running cpubench via QEMU~~ Utilize GitHub Actions for building and running via QEMU Jul 4, 2025

G36maid and others added 5 commits July 4, 2025 11:03

Add CI workflow for building and testing

7e182f6

Correct return type of strlen function

47028a4

strlen() returns the length of the input string, which is always non‑negative. Switching the return type to size_t is more accurately.

Ensure consistent indention

6b935dc

G36maid force-pushed the main branch from a1576cf to 77ff0a9 Compare July 4, 2025 03:06

G36maid requested a review from jserv July 4, 2025 03:08

jserv requested changes Jul 4, 2025

View reviewed changes

jserv reviewed Jul 4, 2025

View reviewed changes

.github/workflows/ci.yml Outdated Show resolved Hide resolved

jserv reviewed Jul 4, 2025

View reviewed changes

.github/workflows/ci.yml Outdated Show resolved Hide resolved

jserv reviewed Jul 4, 2025

View reviewed changes

kernel/error.c Outdated Show resolved Hide resolved

G36maid marked this pull request as draft July 4, 2025 03:18

jserv reviewed Jul 4, 2025

View reviewed changes

lib/libc.c Outdated Show resolved Hide resolved

jserv mentioned this pull request Jul 4, 2025

Enable CI via GitHub Actions #2

Open

G36maid force-pushed the main branch from bd17f4e to b273fc7 Compare July 4, 2025 03:32

jserv requested changes Jul 4, 2025

View reviewed changes

G36maid force-pushed the main branch from e2a6d00 to 4e2656f Compare July 4, 2025 03:36

G36maid closed this Jul 4, 2025

G36maid mentioned this pull request Jul 4, 2025

Utilize GitHub Actions for building and running via QEMU #12

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Utilize GitHub Actions for building and running via QEMU #11

Utilize GitHub Actions for building and running via QEMU #11

Uh oh!

G36maid commented Jul 4, 2025 •

edited

Loading

Uh oh!

This comment was marked as duplicate.

Uh oh!

jserv left a comment

Uh oh!

Uh oh!

Uh oh!

jserv Jul 4, 2025

Uh oh!

G36maid Jul 4, 2025

Uh oh!

jserv Jul 4, 2025

Uh oh!

G36maid Jul 4, 2025

Uh oh!

Uh oh!

jserv commented Jul 4, 2025

Uh oh!

Uh oh!

jserv left a comment

Uh oh!

jserv commented Jul 4, 2025

Uh oh!

G36maid commented Jul 4, 2025 •

edited

Loading

Uh oh!

G36maid commented Jul 4, 2025 •

edited

Loading

Uh oh!

G36maid commented Jul 4, 2025

Uh oh!

Uh oh!

		wget https://github.com/riscv-collab/riscv-gnu-toolchain/releases/download/2025.06.13/riscv32-elf-ubuntu-22.04-gcc-nightly-2025.06.13-nightly.tar.xz
		tar -xf riscv32-elf-ubuntu-22.04-gcc-nightly-2025.06.13-nightly.tar.xz

Utilize GitHub Actions for building and running via QEMU #11

Utilize GitHub Actions for building and running via QEMU #11

Uh oh!

Conversation

G36maid commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Notes

Ongoing Work

Uh oh!

This comment was marked as duplicate.

Uh oh!

jserv left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

jserv Jul 4, 2025

Choose a reason for hiding this comment

Uh oh!

G36maid Jul 4, 2025

Choose a reason for hiding this comment

Uh oh!

jserv Jul 4, 2025

Choose a reason for hiding this comment

Uh oh!

G36maid Jul 4, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jserv commented Jul 4, 2025

Uh oh!

Uh oh!

jserv left a comment

Choose a reason for hiding this comment

Uh oh!

jserv commented Jul 4, 2025

Uh oh!

G36maid commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

G36maid commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

G36maid commented Jul 4, 2025

Uh oh!

Uh oh!

G36maid commented Jul 4, 2025 •

edited

Loading

G36maid commented Jul 4, 2025 •

edited

Loading

G36maid commented Jul 4, 2025 •

edited

Loading