Re: systemd-journal segfaulting with 7.3-rc1 on ppc64le
From: Dan Horák <hidden>
Date: 2026-09-04 11:56:05
On Fri, 4 Sep 2026 13:30:54 +0200 Michal Suchánek [off-list ref] wrote:
On Fri, Sep 04, 2026 at 12:53:49PM +0200, Dan Horák wrote:quoted
Hi, I am using the rc kernels via https://fedoraproject.org/wiki/RawhideKernelNodebug on my Fedora 44 Power9 based system (Talos II) and after installing kernel-7.3.0-0.rc1.18.fc46.ppc64le my system failed to boot successfully and I have found systemd-journal segfaults in the boot log like this [ 12.485876] systemd-coredump[1464]: Process 1409 (systemd-journal) of user 0 terminated abnormally with signal 6/ABRT, processing... [ 12.578533] systemd-coredump[1464]: Process 1409 (systemd-journal) of user 0 dumped core. [ 12.578554] systemd-coredump[1464]: Coredump diverted to /var/lib/systemd/coredump/core.systemd-journal.0.b7f8bc16143c4cc1832aeb4c64ff16a4.1409.1788339090000000.zst [ 12.578560] systemd-coredump[1464]: Module libpcre2-8.so.0 from rpm pcre2-10.47-1.fc44.1.ppc64le [ 12.578566] systemd-coredump[1464]: Module libselinux.so.1 from rpm libselinux-3.11-1.fc44.ppc64le [ 12.578572] systemd-coredump[1464]: Module libz.so.1 from rpm zlib-ng-2.3.3-3.fc44.ppc64le [ 12.578578] systemd-coredump[1464]: Module libcrypto.so.3 from rpm openssl-3.5.8-1.fc44.ppc64le [ 12.578583] systemd-coredump[1464]: Module libcrypt.so.2 from rpm libxcrypt-4.5.2-3.fc44.ppc64le [ 12.578596] systemd-coredump[1464]: Module libsystemd-shared-259.8-1.fc44.so from rpm systemd-259.8-1.fc44.ppc64le [ 12.578602] systemd-coredump[1464]: Module systemd-journald from rpm systemd-259.8-1.fc44.ppc64le [ 12.578608] systemd-coredump[1464]: Stack trace of thread 1409: [ 12.578613] systemd-coredump[1464]: #0 0x00007fffaa82ae74 abort (libc.so.6 + 0x2ae74) [ 12.578619] systemd-coredump[1464]: #1 0x00007fffaa8a4e60 __libc_message_impl (libc.so.6 + 0xa4e60) [ 12.578624] systemd-coredump[1464]: #2 0x00007fffaa8a4eec __libc_fatal (libc.so.6 + 0xa4eec) [ 12.578630] systemd-coredump[1464]: #3 0x00007fffaa8b54bc start_thread (libc.so.6 + 0xb54bc) [ 12.578635] systemd-coredump[1464]: #4 0x00007fffaa9613e8 __clone (libc.so.6 + 0x1613e8) [ 12.578641] systemd-coredump[1464]: #5 0x00007fffaa9613e8 __clone (libc.so.6 + 0x1613e8) [ 12.578646] systemd-coredump[1464]: #6 0x00007fffaa8b4e40 create_thread.constprop.0 (libc.so.6 + 0xb4e40) [ 12.578652] systemd-coredump[1464]: #7 0x00007fffe66094a0 n/a (n/a + 0x0) [ 12.578657] systemd-coredump[1464]: ELF object binary architecture: PowerPC64 [ 12.646917] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 2. I have reproduced the behaviour with the latest mainline kernel and my bisecting points to https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=3424d8c18a7da1010d03391a22e728b857d0d5c5 (which is not that helpful as it is a merge commit). There are also messages about "dbus-broker.service: Failed with result 'exit-code'", so the journal crash might be a symptom of another root cause. Using the Fedora prebuilt kernels - kernel-7.3.0-0.rc0.260818g0f23d56f17fd.3.fc46.ppc64le = OK - kernel-7.3.0-0.rc0.260819gbd5f485f3f02.5.fc46.ppc64le = BAD doesn't help much in narrowing as it is when the big merges happened. --- git bisect start # status: waiting for both 'good' and 'bad' commits # good: [8d3ae59288f1e7d58d76558a6ee96d533bc5019f] Linux 7.2 git bisect good 8d3ae59288f1e7d58d76558a6ee96d533bc5019f # status: waiting for 'bad' commit, 1 'good' commit known # bad: [cee9395acd8043be0644b25c34bfa86623f2b935] Linux 7.3-rc1 git bisect bad cee9395acd8043be0644b25c34bfa86623f2b935 # bad: [55ab7e14222e5f0b0fd9f7711ca391d2924b35e3] Merge tag 'for-7.3/block-20260819' of git://git.kernel.org/pub/scm/linux/kernel/git/axboe/linux git bisect bad 55ab7e14222e5f0b0fd9f7711ca391d2924b35e3 # bad: [e5c91aac491def6ab3f90c4cc246e3fcb0f8f058] Merge tag 'sound-7.3-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound git bisect bad e5c91aac491def6ab3f90c4cc246e3fcb0f8f058 # bad: [cbe8aadf1551f3f4a853f24b3b96d9f0eea49c53] Merge tag 'soc-dt-7.3' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc git bisect bad cbe8aadf1551f3f4a853f24b3b96d9f0eea49c53 # bad: [762fffa407d8d24288513538cf5d17c2c5425258] Merge tag 'irq-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 762fffa407d8d24288513538cf5d17c2c5425258 # good: [a5778046a02570fd23bdf0b48dce330237d1996c] Merge tag 'pm-7.3-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm git bisect good a5778046a02570fd23bdf0b48dce330237d1996c # good: [85cdaca6970028bf6f544c355c90035586836ddf] Merge tag 'arm64-upstream' of git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux git bisect good 85cdaca6970028bf6f544c355c90035586836ddf # good: [8915457146a11d20a6c0786396376afda65eec40] Merge tag 'perf-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 8915457146a11d20a6c0786396376afda65eec40 # good: [e2457a664ea02c414c6b9828bff3a0df4c300f63] Merge tag 'sched-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good e2457a664ea02c414c6b9828bff3a0df4c300f63 # good: [3a0dd7ba4f44cdc116d83712f61e7c1a95be3588] Merge tag 'x86-documentation-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 3a0dd7ba4f44cdc116d83712f61e7c1a95be3588 # good: [fb419d53f2619e29bf4f96613d9a614e1c263736] x86/entry: Simplify the syscall number logic git bisect good fb419d53f2619e29bf4f96613d9a614e1c263736 # bad: [6138016752322261e26ac88eaeb64c0c890f98a2] Merge tag 'core-rseq-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 6138016752322261e26ac88eaeb64c0c890f98a2 # good: [71ff30013f19ca46c2c72c25731c32b6cc7b5620] entry: Make return type of syscall_trace_enter() bool git bisect good 71ff30013f19ca46c2c72c25731c32b6cc7b5620 # good: [2a98ffac7733e77a178af7240f9fa9392ca45aad] selftests/rseq: Add missing test binaries to .gitignore git bisect good 2a98ffac7733e77a178af7240f9fa9392ca45aad # bad: [3424d8c18a7da1010d03391a22e728b857d0d5c5] Merge tag 'core-entry-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 3424d8c18a7da1010d03391a22e728b857d0d5c5 # good: [05c033db7e9ad3c34f6968ec568cb6ee01051c57] entry, treewide: Make syscall_enter_from_user_mode[_work]() indicate syscall execution git bisect good 05c033db7e9ad3c34f6968ec568cb6ee01051c57 # first 'bad' commit: [3424d8c18a7da1010d03391a22e728b857d0d5c5] Merge tag 'core-entry-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip --- Also can be reproduced by using the recent Fedora Rawhide installers which won't initialize properly.Hello, can you try applying recent fixes for the entry code? https://lore.kernel.org/all/10c86c909f870d90b3094f76b692b44ebe9caeac.1787976185.git.ritesh.list@gmail.com/ (local) powerpc: Don't drop _TIF_RESTOREALL on syscall restart https://lore.kernel.org/all/20260820134718.2176411-1-mkchauras@gmail.com/ (local) powerpc/entry: Fix irq_soft_mask corruption on replayed https://lore.kernel.org/all/52fee44fd23acf8e1c024ace668728e626a783a8.1788101609.git.ritesh.list@gmail.com/ (local) powerpc: Do not restore KUAP in https://lore.kernel.org/all/20260828053811.1042300-1-sshegde@linux.ibm.com/ (local) powerpc/entry: Clear TIF_SYSCALL_RET before syscall error https://lore.kernel.org/all/20260904025831.3439809-1-aboorvad@linux.ibm.com/ (local) powerpc/entry: Fix double accounting of user time on
thanks for pointers, Michal. With all of them applied the crash goes away. Forgot to mention that I tried with the "powerpc: Don't drop _TIF_RESTOREALL on syscall restart" alone and it didn't help. Dan