From: Wupeng Ma <hidden> Date: 2022-03-26 06:27:47
From: Ma Wupeng <redacted>
Commit b05b9f5f9dcf ("x86, mirror: x86 enabling - find mirrored memory ranges")
introduced mirrored memory support for x86. This support rely on UEFI to
report mirrored memory address ranges. See UEFI 2.5 spec pages 157-158:
http://www.uefi.org/sites/default/files/resources/UEFI%202_5.pdf
Arm64 can support this too. So mirrored memory support is added to support
arm64.
Patch #1-#2 introduce efi_fake_mem support for arm64.
Patch #3-#4 introduce mirrored memory support form arm64.
Patch #5-#7 fix some bugs for arm64 if memory reliable is enabled.
Patch #8 disable mirror feature if kernelcore is not specified.
Patch #9 remove some redundant code in ia64 efi_init.
Ma Wupeng (9):
efi: Make efi_print_memmap() public
arm64: efi: Add fake memory support
efi: Make efi_find_mirror() public
arm64/mirror: arm64 enabling - find mirrored memory ranges
mm: Ratelimited mirrored memory related warning messages
mm: Demote warning message in vmemmap_verify() to debug level
mm: Calc the right pfn if page size is not 4K
efi: Disable mirror feature if kernelcore is not specified
ia64/efi: Code simplification in efi_init
.../admin-guide/kernel-parameters.txt | 4 +-
arch/arm64/kernel/setup.c | 3 ++
arch/ia64/kernel/efi.c | 37 +-----------------
arch/x86/include/asm/efi.h | 5 ---
arch/x86/platform/efi/efi.c | 39 -------------------
drivers/firmware/efi/Kconfig | 2 +-
drivers/firmware/efi/efi.c | 26 +++++++++++++
drivers/firmware/efi/memmap.c | 16 ++++++++
include/linux/efi.h | 4 ++
include/linux/mm.h | 2 +
mm/memblock.c | 4 +-
mm/page_alloc.c | 4 +-
mm/sparse-vmemmap.c | 2 +-
13 files changed, 60 insertions(+), 88 deletions(-)
--
2.18.0.huawei.25
_______________________________________________
linux-arm-kernel mailing list
linux-arm-kernel@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
From: Wupeng Ma <hidden> Date: 2022-03-26 06:27:57
From: Ma Wupeng <redacted>
Fake memory map is used for faking memory's attribute values.
Commit 0f96a99dab36 ("efi: Add "efi_fake_mem" boot option") introduce the
efi_fake_mem function. Now it can support arm64 with this patch.
For example you can mark 0-6G memory as EFI_MEMORY_MORE_RELIABLE by adding
efi_fake_mem=6G@0:0x10000 in the bootarg. You find more info about
fake memmap in kernel-parameters.txt.
Variable memstart_addr is only confirmed after arm64_memblock_init(). So
efi_fake_memmap() is needed to add after arm64_memblock_init().
Otherwise:
efi_memmap_alloc
memblock_phys_alloc
kmemleak_alloc_phys
kmemleak_alloc(__va(phys), size, min_count, gfp);
this __va() will convert phys to a fault va and lead to a kmemleak error.
Signed-off-by: Ma Wupeng <redacted>
---
Documentation/admin-guide/kernel-parameters.txt | 2 +-
arch/arm64/kernel/setup.c | 2 ++
drivers/firmware/efi/Kconfig | 2 +-
3 files changed, 4 insertions(+), 2 deletions(-)
@@ -1357,7 +1357,7 @@ you are really sure that your UEFI does sane gc and fulfills the spec otherwise your board may brick.- efi_fake_mem= nn[KMG]@ss[KMG]:aa[,nn[KMG]@ss[KMG]:aa,..] [EFI; X86]+ efi_fake_mem= nn[KMG]@ss[KMG]:aa[,nn[KMG]@ss[KMG]:aa,..] [EFI; X86; ARM64] Add arbitrary attribute to specific memory range by updating original EFI memory map. Region of memory which aa attribute is added to is
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:01
From: Ma Wupeng <redacted>
Commit b05b9f5f9dcf ("x86, mirror: x86 enabling - find mirrored memory
ranges") introduce the efi_find_mirror function on x86. In order to reuse
the API we make it public in preparation for arm64 to support mirrord
memory.
Signed-off-by: Ma Wupeng <redacted>
---
arch/x86/include/asm/efi.h | 4 ----
arch/x86/platform/efi/efi.c | 23 -----------------------
drivers/firmware/efi/efi.c | 23 +++++++++++++++++++++++
include/linux/efi.h | 3 +++
4 files changed, 26 insertions(+), 27 deletions(-)
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:05
From: Ma Wupeng <redacted>
Commit b05b9f5f9dcf ("x86, mirror: x86 enabling - find mirrored memory ranges")
introduced mirrored memory support for x86 and this could be used on arm64.
So efi_find_mirror() is added in efi_init() so on EFI enabled systems scan
the memory map and tell memblock about any mirrored ranges.
Signed-off-by: Ma Wupeng <redacted>
---
Documentation/admin-guide/kernel-parameters.txt | 2 +-
arch/arm64/kernel/setup.c | 1 +
2 files changed, 2 insertions(+), 1 deletion(-)
@@ -2270,7 +2270,7 @@ keepinitrd [HW,ARM]- kernelcore= [KNL,X86,IA-64,PPC]+ kernelcore= [KNL,X86,IA-64,PPC,ARM64] Format: nn[KMGTPE] | nn% | "mirror" This parameter specifies the amount of memory usable by the kernel for non-movable allocations. The requested
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:15
From: Ma Wupeng <redacted>
If system has mirrored memory, memblock will try to allocate mirrored
memory firstly and fallback to non-mirrored memory when fails, but if with
limited mirrored memory or some numa node without mirrored memory, lots of
warning message about memblock allocation will occur.
This patch ratelimit the warning message to avoid a very long print during
bootup.
Signed-off-by: Ma Wupeng <redacted>
---
mm/memblock.c | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:25
From: Ma Wupeng <redacted>
For a system only have limited mirrored memory or some numa node without
mirrored memory, the per node vmemmap page_structs prefer to allocate
memory from mirrored region, which will lead to vmemmap_verify() report
lots of warning message.
This patch demote the "potential offnode page_structs" warning messages
to debug level to avoid a very long print during bootup.
Signed-off-by: Ma Wupeng <redacted>
---
mm/sparse-vmemmap.c | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:31
From: Ma Wupeng <redacted>
Pervious 0x100000 is used to check the 4G limit in
find_zone_movable_pfns_for_nodes(). This is right in x86 because
the page size can only be 4K. But 16K and 64K are available in
arm64. So replate it with SIZE_4G >> PAGE_SHIFT.
Signed-off-by: Ma Wupeng <redacted>
---
mm/page_alloc.c | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:34
From: Ma Wupeng <redacted>
With this patch, kernel will check mirrored_kernelcore before calling
efi_find_mirror() which will enable basic mirrored feature.
If system have some mirrored memory and mirrored feature is not specified
in boot parameter, the basic mirrored feature will be enabled and this will
lead to the following situations:
- memblock memory allocation perfers mirrored region. This may have some
unexpected influence on numa affinity.
- contiguous memory will be splited into several parts if parts of them
is mirrored memory via memblock_mark_mirror().
Signed-off-by: Ma Wupeng <redacted>
---
drivers/firmware/efi/efi.c | 3 +++
include/linux/mm.h | 2 ++
mm/page_alloc.c | 2 +-
3 files changed, 6 insertions(+), 1 deletion(-)
@@ -355,7 +355,7 @@ static unsigned long required_kernelcore_percent __initdata;staticunsignedlongrequired_movablecore__initdata;staticunsignedlongrequired_movablecore_percent__initdata;staticunsignedlongzone_movable_pfn[MAX_NUMNODES]__initdata;-staticboolmirrored_kernelcore__meminitdata;+boolmirrored_kernelcore__meminitdata;/* movable_zone is the "real" zone pages in ZONE_MOVABLE are taken from */intmovable_zone;
--
2.18.0.huawei.25
_______________________________________________
linux-arm-kernel mailing list
linux-arm-kernel@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
From: Wupeng Ma <hidden> Date: 2022-03-26 06:28:42
From: Ma Wupeng <redacted>
Since efi_print_memmap() was made public, print EFI memory map in
efi_init() can be simplified by using efi_print_memmap().
Signed-off-by: Ma Wupeng <redacted>
---
arch/ia64/kernel/efi.c | 37 +------------------------------------
1 file changed, 1 insertion(+), 36 deletions(-)
From: David Hildenbrand <hidden> Date: 2022-03-28 12:34:03
On 26.03.22 07:46, Wupeng Ma wrote:
From: Ma Wupeng <redacted>
Pervious 0x100000 is used to check the 4G limit in
s/Pervious/Previous/
find_zone_movable_pfns_for_nodes(). This is right in x86 because
the page size can only be 4K. But 16K and 64K are available in
arm64. So replate it with SIZE_4G >> PAGE_SHIFT.
From: Ma Wupeng <redacted>
Pervious 0x100000 is used to check the 4G limit in
s/Pervious/Previous/
quoted
find_zone_movable_pfns_for_nodes(). This is right in x86 because
the page size can only be 4K. But 16K and 64K are available in
arm64. So replate it with SIZE_4G >> PAGE_SHIFT.
On Sat, 26 Mar 2022 at 07:27, Wupeng Ma [off-list ref] wrote:
From: Ma Wupeng <redacted>
Commit b05b9f5f9dcf ("x86, mirror: x86 enabling - find mirrored memory ranges")
introduced mirrored memory support for x86. This support rely on UEFI to
report mirrored memory address ranges. See UEFI 2.5 spec pages 157-158:
http://www.uefi.org/sites/default/files/resources/UEFI%202_5.pdf
Arm64 can support this too. So mirrored memory support is added to support
arm64.
What is the point of this if the kernel itself is not loaded in
EFI_MORE_RELIABLE memory? On x86, this is handled by the decompressor,
but that does not exist on arm64.
The problem here is that UEFI defines this as a memory *attribute*
rather than a memory *type*, which means you cannot allocate
EFI_MORE_RELIABLE memory easily: you have to iterate over the memory
map and look for regions with the desired attribute, and allocate
those pages explicitly. I'd prefer to implement this in the
bootloader, and only add minimal logic to the stub to respect the
placement of the kernel by the loader if the loader signals it to do
so (there are other reasons for this - I will cc you on a patch
shortly that implements this)
This also means that the fake_mem stuff is not going to work: the
memory map observed by the stub comes straight from the firmware, and
if the stub needs to be involved in placing (or respecting the
placement by the loader of) the kernel image, it needs to observe
those EFI_MORE_RELIABLE regions too. If you don't have access to a
machine that actually exposes EFI_MORE_RELIABLE memory, I suggest you
prototype it in QEMU/edk2 instead.
In fact, we have been trying very hard not to touch the firmware
provided memory map at all on ARM, rather than use it as a scratchpad
for all kinds of annotations. This means, for instance, that kexec is
idempotent - the next kernel should not be affected by modifications
to the memory map applied by the previous kernel.
In summary, implementing kernelcore=mirror for arm64 is fine with me,
but there are some issues we need to address first.
Patch #1-#2 introduce efi_fake_mem support for arm64.
Patch #3-#4 introduce mirrored memory support form arm64.
Patch #5-#7 fix some bugs for arm64 if memory reliable is enabled.
Patch #8 disable mirror feature if kernelcore is not specified.
Patch #9 remove some redundant code in ia64 efi_init.
Ma Wupeng (9):
efi: Make efi_print_memmap() public
arm64: efi: Add fake memory support
efi: Make efi_find_mirror() public
arm64/mirror: arm64 enabling - find mirrored memory ranges
mm: Ratelimited mirrored memory related warning messages
mm: Demote warning message in vmemmap_verify() to debug level
mm: Calc the right pfn if page size is not 4K
efi: Disable mirror feature if kernelcore is not specified
ia64/efi: Code simplification in efi_init
.../admin-guide/kernel-parameters.txt | 4 +-
arch/arm64/kernel/setup.c | 3 ++
arch/ia64/kernel/efi.c | 37 +-----------------
arch/x86/include/asm/efi.h | 5 ---
arch/x86/platform/efi/efi.c | 39 -------------------
drivers/firmware/efi/Kconfig | 2 +-
drivers/firmware/efi/efi.c | 26 +++++++++++++
drivers/firmware/efi/memmap.c | 16 ++++++++
include/linux/efi.h | 4 ++
include/linux/mm.h | 2 +
mm/memblock.c | 4 +-
mm/page_alloc.c | 4 +-
mm/sparse-vmemmap.c | 2 +-
13 files changed, 60 insertions(+), 88 deletions(-)
--
2.18.0.huawei.25
On Sat, 26 Mar 2022 at 07:27, Wupeng Ma [off-list ref] wrote:
quoted
From: Ma Wupeng <redacted>
Commit b05b9f5f9dcf ("x86, mirror: x86 enabling - find mirrored memory ranges")
introduced mirrored memory support for x86. This support rely on UEFI to
report mirrored memory address ranges. See UEFI 2.5 spec pages 157-158:
http://www.uefi.org/sites/default/files/resources/UEFI%202_5.pdf
Arm64 can support this too. So mirrored memory support is added to support
arm64.
What is the point of this if the kernel itself is not loaded in
EFI_MORE_RELIABLE memory? On x86, this is handled by the decompressor,
but that does not exist on arm64.
Do you mean this is x86, commit c05cd79750fb
("x86/boot/KASLR: Prefer mirrored memory regions for the kernel physical address").
This scenario is not considered.
The problem here is that UEFI defines this as a memory *attribute*
rather than a memory *type*, which means you cannot allocate
EFI_MORE_RELIABLE memory easily: you have to iterate over the memory
map and look for regions with the desired attribute, and allocate
those pages explicitly. I'd prefer to implement this in the
bootloader, and only add minimal logic to the stub to respect the
placement of the kernel by the loader if the loader signals it to do
so (there are other reasons for this - I will cc you on a patch
shortly that implements this)
Thanks for your incoming patch.
This also means that the fake_mem stuff is not going to work: the
memory map observed by the stub comes straight from the firmware, and
if the stub needs to be involved in placing (or respecting the
placement by the loader of) the kernel image, it needs to observe
those EFI_MORE_RELIABLE regions too. If you don't have access to a
machine that actually exposes EFI_MORE_RELIABLE memory, I suggest you
prototype it in QEMU/edk2 instead.
You are right fake_mem stuff is not going to work. But, efi_fake_mem is
used for testing mirrored features and will not be used in production
environment. This test features can fake memory's attribute values.
The reason why efi_fake_mem support is put first is that memory's attribute
is reported by BIOS which is hard to simulate. With this support, any arm64
machines with efi support can easily test mirrored features.
In fact, we have been trying very hard not to touch the firmware
provided memory map at all on ARM, rather than use it as a scratchpad
for all kinds of annotations. This means, for instance, that kexec is
idempotent - the next kernel should not be affected by modifications
to the memory map applied by the previous kernel.
Yes, you're absolutely right. Efi_fake_mem is incompatible with kdump which
will use kexec. But we can remove specify cmdline(efi_fake_mem=xx) by
modofing /etc/sysconfig/kdump. Efi_fake_mem is only used for testing and
will not be used in production environment.
In summary, implementing kernelcore=mirror for arm64 is fine with me,
but there are some issues we need to address first.
Can you be clear what the issues are?
The main purpose of this patchset is to introduce mirrored support for
arm64 and we have already fixed the problems we had which is shown in
patch #5 to patch #7 and try to bring total isolation in patch #8 which
will disable mirror feature if kernelcore is not specified.
Thanks for reviewing.
quoted
Patch #1-#2 introduce efi_fake_mem support for arm64.
Patch #3-#4 introduce mirrored memory support form arm64.
Patch #5-#7 fix some bugs for arm64 if memory reliable is enabled.
Patch #8 disable mirror feature if kernelcore is not specified.
Patch #9 remove some redundant code in ia64 efi_init.
Ma Wupeng (9):
efi: Make efi_print_memmap() public
arm64: efi: Add fake memory support
efi: Make efi_find_mirror() public
arm64/mirror: arm64 enabling - find mirrored memory ranges
mm: Ratelimited mirrored memory related warning messages
mm: Demote warning message in vmemmap_verify() to debug level
mm: Calc the right pfn if page size is not 4K
efi: Disable mirror feature if kernelcore is not specified
ia64/efi: Code simplification in efi_init
.../admin-guide/kernel-parameters.txt | 4 +-
arch/arm64/kernel/setup.c | 3 ++
arch/ia64/kernel/efi.c | 37 +-----------------
arch/x86/include/asm/efi.h | 5 ---
arch/x86/platform/efi/efi.c | 39 -------------------
drivers/firmware/efi/Kconfig | 2 +-
drivers/firmware/efi/efi.c | 26 +++++++++++++
drivers/firmware/efi/memmap.c | 16 ++++++++
include/linux/efi.h | 4 ++
include/linux/mm.h | 2 +
mm/memblock.c | 4 +-
mm/page_alloc.c | 4 +-
mm/sparse-vmemmap.c | 2 +-
13 files changed, 60 insertions(+), 88 deletions(-)
--
2.18.0.huawei.25