OpenBSD 7.4+ does not boot on sbsa-ref with Neoverse-V1/N2 or max cpu core Description of problem: System boots and then hangs: ``` disks: sd0* >> OpenBSD/arm64 BOOTAA64 1.18 boot> cannot open sd0a:/etc/random.seed: No such file or directory booting sd0a:/bsd: 2861736+1091248+12711584+634544 [233295+91+666048+260913]=0x1 3d5cf8 FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2023 OpenBSD. All rights reserved. https://www.OpenBSD.org OpenBSD 7.4 (RAMDISK) #2131: Sun Oct 8 13:35:40 MDT 2023 deraadt@arm64.openbsd.org:/usr/src/sys/arch/arm64/compile/RAMDISK real mem = 1066156032 (1016MB) avail mem = 996659200 (950MB) random: boothowto does not indicate good seed mainbus0 at root: ACPI psci0 at mainbus0: PSCI 1.1, SMCCC 1.4 efi0 at mainbus0: UEFI 2.7 efi0: EFI Development Kit II / SbsaQemu rev 0x10000 smbios0 at efi0: SMBIOS 3.4.0 smbios0: vendor EFI Development Kit II / SbsaQemu version "1.0" date 03/13/2024 smbios0: QEMU QEMU SBSA-REF Machine cpu0 at mainbus0 mpidr 0: ARM Neoverse N2 r0p3 cpu0: 0KB 64b/line 4-way L1 PIPT I-cache, 0KB 64b/line 4-way L1 D-cache cpu0: 0KB 64b/line 8-way L2 cache cpu0: RNDR,TLBIOS+IRANGE,TS+AXFLAG,FHM,DP,SM4,SM3,SHA3,RDM,Atomic,CRC32,SHA2+SHA512,SHA1,AES+PMULL,SPECRES,SB,FRINTTS,GPI,GPA,LRCPC+LDAPUR,FCMA,JSCVT,APA+PAC,DPB,ASID16,PAN+ATS1E1,LO,HPDS,VH,HAFDBS,CSV3,CSV2+SCXT,DIT,BT,SBSS+MSR agintc0 at mainbus0 shift 4:3 nirq 288 nredist 4: "interrupt-controller" agintcmsi0 at agintc0 agtimer0 at mainbus0: 62500 kHz acpi0 at mainbus0: ACPI 6.0 acpi0: tables DSDT FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT acpimcfg0 at acpi0 acpimcfg0: addr 0xf0000000, bus 0-255 acpiiort0 at acpi0 pluart0 at acpi0 COM0 addr 0x60000000/0x1000 irq 33 pluart0: console ahci0 at acpi0 AHC0 addr 0x60100000/0x10000 irq 42: AHCI 1.0 ahci0: port 0: 1.5Gb/s scsibus0 at ahci0: 32 targets sd0 at scsibus0 targ 0 lun 0: t10.ATA_QEMU_HARDDISK_QM00001_ sd0: 43MB, 512 bytes/sector, 88064 sectors, thin xhci0 at acpi0 USB0 addr 0x60110000/0x10000 irq 43, xHCI 0.0 usb0 at xhci0: USB revision 3.0 uhub0 at usb0 configuration 1 interface 0 "Generic xHCI root hub" rev 3.00/1.00 addr 1 acpipci0 at acpi0 PCI0 pci0 at acpipci0 0:1:0: rom address conflict 0xfffc0000/0x40000 0:2:0: rom address conflict 0xffff8000/0x8000 "Red Hat Host" rev 0x00 at pci0 dev 0 function 0 not configured em0 at pci0 dev 1 function 0 "Intel 82574L" rev 0x00: msi, address 52:54:00:12:34:56 "Bochs VGA" rev 0x02 at pci0 dev 2 function 0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured simplefb0 at mainbus0: 1280x800, 32bpp wsdisplay0 at simplefb0 mux 1 wsdisplay0: screen 0 added (std, vt100 emulation) ``` If I use Neoverse-N1 (sbsa-ref default core type) then it boots into installer: ``` disks: sd0* >> OpenBSD/arm64 BOOTAA64 1.18 boot> cannot open sd0a:/etc/random.seed: No such file or directory booting sd0a:/bsd: 2861736+1091248+12711584+634544 [233295+91+666048+260913]=0x1 3d5cf8 FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2023 OpenBSD. All rights reserved. https://www.OpenBSD.org OpenBSD 7.4 (RAMDISK) #2131: Sun Oct 8 13:35:40 MDT 2023 deraadt@arm64.openbsd.org:/usr/src/sys/arch/arm64/compile/RAMDISK real mem = 1066156032 (1016MB) avail mem = 996659200 (950MB) random: boothowto does not indicate good seed mainbus0 at root: ACPI psci0 at mainbus0: PSCI 1.1, SMCCC 1.4 efi0 at mainbus0: UEFI 2.7 efi0: EFI Development Kit II / SbsaQemu rev 0x10000 smbios0 at efi0: SMBIOS 3.4.0 smbios0: vendor EFI Development Kit II / SbsaQemu version "1.0" date 03/13/2024 smbios0: QEMU QEMU SBSA-REF Machine cpu0 at mainbus0 mpidr 0: ARM Neoverse N1 r4p1 cpu0: 64KB 64b/line 4-way L1 PIPT I-cache, 64KB 64b/line 4-way L1 D-cache cpu0: 1024KB 64b/line 8-way L2 cache cpu0: DP,RDM,Atomic,CRC32,SHA2,SHA1,AES+PMULL,LRCPC,DPB,ASID16,PAN+ATS1E1,LO,HPDS,VH,HAFDBS,CSV3,CSV2,SBSS+MSR agintc0 at mainbus0 shift 4:3 nirq 288 nredist 4: "interrupt-controller" agintcmsi0 at agintc0 agtimer0 at mainbus0: 62500 kHz acpi0 at mainbus0: ACPI 6.0 acpi0: tables DSDT FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT acpimcfg0 at acpi0 acpimcfg0: addr 0xf0000000, bus 0-255 acpiiort0 at acpi0 pluart0 at acpi0 COM0 addr 0x60000000/0x1000 irq 33 pluart0: console ahci0 at acpi0 AHC0 addr 0x60100000/0x10000 irq 42: AHCI 1.0 ahci0: port 0: 1.5Gb/s scsibus0 at ahci0: 32 targets sd0 at scsibus0 targ 0 lun 0: t10.ATA_QEMU_HARDDISK_QM00001_ sd0: 43MB, 512 bytes/sector, 88064 sectors, thin xhci0 at acpi0 USB0 addr 0x60110000/0x10000 irq 43, xHCI 0.0 usb0 at xhci0: USB revision 3.0 uhub0 at usb0 configuration 1 interface 0 "Generic xHCI root hub" rev 3.00/1.00 addr 1 acpipci0 at acpi0 PCI0 pci0 at acpipci0 0:1:0: rom address conflict 0xfffc0000/0x40000 0:2:0: rom address conflict 0xffff8000/0x8000 "Red Hat Host" rev 0x00 at pci0 dev 0 function 0 not configured em0 at pci0 dev 1 function 0 "Intel 82574L" rev 0x00: msi, address 52:54:00:12:34:56 "Bochs VGA" rev 0x02 at pci0 dev 2 function 0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured simplefb0 at mainbus0: 1280x800, 32bpp wsdisplay0 at simplefb0 mux 1 wsdisplay0: screen 0 added (std, vt100 emulation) softraid0 at root scsibus1 at softraid0: 256 targets root on rd0a swap on rd0b dump on rd0b WARNING: CHECK AND RESET THE DATE! erase ^?, werase ^W, kill ^U, intr ^C, status ^T Welcome to the OpenBSD/arm64 7.4 installation program. (I)nstall, (U)pgrade, (A)utoinstall or (S)hell? ``` Steps to reproduce: 1. download OpenBSD 7.4 image: https://cdn.openbsd.org/pub/OpenBSD/7.4/arm64/miniroot74.img 2. download sbsa-ref firmware files from https://artifacts.codelinaro.org/ui/native/linaro-419-sbsa-ref/20240313-116475/edk2/ and decompress them 3. start qemu-system-aarch64 as shown above (adapt paths if needed) 4. watch console serial output Additional information: I am going to discuss this on OpenBSD mailing list. Will point to this bug. OpenBSD 7.5-current snapshot works on Neoverse-N1 and fails on Neoverse-V1/N2/max: ``` disks: sd0* >> OpenBSD/arm64 BOOTAA64 1.18 boot> cannot open sd0a:/etc/random.seed: No such file or directory booting sd0a:/bsd: 3015576+1213504+12712936+634144 [269381+91+701664+287051]=0x1 3edee0 FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2024 OpenBSD. All rights reserved. https://www.OpenBSD.org OpenBSD 7.5 (RAMDISK) #121: Thu Mar 14 03:28:46 MDT 2024 deraadt@arm64.openbsd.org:/usr/src/sys/arch/arm64/compile/RAMDISK real mem = 1066147840 (1016MB) avail mem = 992886784 (946MB) random: boothowto does not indicate good seed mainbus0 at root: ACPI psci0 at mainbus0: PSCI 1.1, SMCCC 1.4 efi0 at mainbus0: UEFI 2.7 efi0: EFI Development Kit II / SbsaQemu rev 0x10000 smbios0 at efi0: SMBIOS 3.4.0 smbios0: vendor EFI Development Kit II / SbsaQemu version "1.0" date 03/13/2024 smbios0: QEMU QEMU SBSA-REF Machine cpu0 at mainbus0 mpidr 0: ARM Neoverse N2 r0p3 cpu0: 0KB 64b/line 4-way L1 PIPT I-cache, 0KB 64b/line 4-way L1 D-cache cpu0: 0KB 64b/line 8-way L2 cache cpu0: RNDR,TLBIOS+IRANGE,TS+AXFLAG,FHM,DP,SM4,SM3,SHA3,RDM,Atomic,CRC32,SHA2+SHA512,SHA1,AES+PMULL,SPECRES,SB,FRINTTS,GPA,LRCPC+LDAPUR,FCMA,JSCVT,APA+PAC,DPB,ASID16,PAN+ATS1E1,LO,HPDS,VH,HAFDBS,CSV3,CSV2+SCXT,DIT,BT,SBSS+MSR,MTE agintc0 at mainbus0 shift 4:3 nirq 288 nredist 4: "interrupt-controller" agintcmsi0 at agintc0 agtimer0 at mainbus0: 62500 kHz acpi0 at mainbus0: ACPI 6.0 acpi0: tables DSDT FACP DBG2 MCFG SPCR IORT APIC SSDT PPTT GTDT BGRT acpimcfg0 at acpi0 acpimcfg0: addr 0xf0000000, bus 0-255 acpiiort0 at acpi0 pluart0 at acpi0 COM0 addr 0x60000000/0x1000 irq 33 pluart0: console ahci0 at acpi0 AHC0 addr 0x60100000/0x10000 irq 42: AHCI 1.0 ahci0: port 0: 1.5Gb/s scsibus0 at ahci0: 32 targets sd0 at scsibus0 targ 0 lun 0: t10.ATA_QEMU_HARDDISK_QM00001_ sd0: 43MB, 512 bytes/sector, 88064 sectors, thin xhci0 at acpi0 USB0 addr 0x60110000/0x10000 irq 43, xHCI 0.0 usb0 at xhci0: USB revision 3.0 uhub0 at usb0 configuration 1 interface 0 "Generic xHCI root hub" rev 3.00/1.00 addr 1 acpipci0 at acpi0 PCI0 pci0 at acpipci0 0:1:0: rom address conflict 0xfffc0000/0x40000 0:2:0: rom address conflict 0xffff8000/0x8000 "Red Hat Host" rev 0x00 at pci0 dev 0 function 0 not configured em0 at pci0 dev 1 function 0 "Intel 82574L" rev 0x00: msi, address 52:54:00:12:34:56 "Bochs VGA" rev 0x02 at pci0 dev 2 function 0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured ```