diff options
Diffstat (limited to 'results/scraper/launchpad-without-comments/1876678')
| -rw-r--r-- | results/scraper/launchpad-without-comments/1876678 | 127 |
1 files changed, 127 insertions, 0 deletions
diff --git a/results/scraper/launchpad-without-comments/1876678 b/results/scraper/launchpad-without-comments/1876678 new file mode 100644 index 000000000..20d298dc5 --- /dev/null +++ b/results/scraper/launchpad-without-comments/1876678 @@ -0,0 +1,127 @@ +Ubuntu 20.04 KVM / QEMU Failure with nested FreeBSD bhyve + +BUG: + +Starting FreeBSD Layer 2 bhyve Guest within Layer 1 FreeBSD VM Host on Layer 0 Ubuntu 20.04 KVM / QEMU Host result in Layer 1 Guest / Host Pausing with "Emulation Failure" + +TESTING: + +My test scenario is nested virtualisation: +Layer 0 - Ubuntu 20.04 Host +Layer 1 - FreeBSD 12.1 with OVMF + bhyve hypervisor Guest/Host +Layer 2 - FreeBSD 12.1 guest + +Layer 0 Host is: Ubuntu 20.04 LTS KVM / QEMU / libvirt + +<<START QEMU VERSION>> +$ virsh -c qemu:///system version --daemon +Compiled against library: libvirt 6.0.0 +Using library: libvirt 6.0.0 +Using API: QEMU 6.0.0 +Running hypervisor: QEMU 4.2.0 +Running against daemon: 6.0.0 +<<END QEMU VERSION> + +<<START Intel VMX Support & Nesting Enabled>> +$ cat /proc/cpuinfo | grep -c vmx +64 +$ cat /sys/module/kvm_intel/parameters/nested +Y +<<END Intel VMS>> + + + +Layer 1 Guest / Host is: FreeBSD Q35 v4.2 with OVMF: + +Pass Host VMX support to Layer 1 Guest via <cpu mode='host-model> + +<<LIBVIRT CONFIG SNIPPET>> +... +... + <os> + <type arch='x86_64' machine='pc-q35-4.2'>hvm</type> + <loader readonly='yes' type='pflash'>/usr/share/OVMF/OVMF_CODE.fd</loader> + <nvram>/home/USER/swarm.bhyve.freebsd/OVMF_VARS.fd</nvram> + </os> + <features> + <acpi/> + <apic/> + <vmport state='off'/> + </features> + <cpu mode='host-model' check='partial'/> +... +... +<END LIBVIRT CONFIG SNIPPET>> + +Checked that Layer 1 - FreeBSD Quest / Host has VMX feature available: + +<<LAYER 1 - FreeBSD CPU Features>> +# uname -a +FreeBSD swarm.DOMAIN.HERE 12.1-RELEASE FreeBSD 12.1-RELEASE GENERIC amd64 + +# grep Features /var/run/dmesg.boot + Features=0xf83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS> + Features2=0xfffa3223<SSE3,PCLMULQDQ,VMX,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV> + AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> + AMD Features2=0x121<LAHF,ABM,Prefetch> + Structured Extended Features=0x1c0fbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,RDSEED,ADX,SMAP> + Structured Extended Features2=0x4<UMIP> + Structured Extended Features3=0xac000400<MD_CLEAR,IBPB,STIBP,ARCH_CAP,SSBD> + XSAVE Features=0x1<XSAVEOPT> +<<END LAYER 1 - FreeBSD CPU Features> + +On Layer 1 FreeBSD Guest / Host start up the Layer 2 guest.. + +<<START LAYER 2 GUEST START>> +# ls +FreeBSD-11.2-RELEASE-amd64-bootonly.iso FreeBSD-12.1-RELEASE-amd64-dvd1.iso bee-hd1-01.img +# /usr/sbin/bhyve -c 2 -m 2048 -H -A -s 0:0,hostbridge -s 1:0,lpc -s 2:0,e1000,tap0 -s 3:0,ahci-hd,bee-hd1-01.img -l com1,stdio -s 5:0,ahci-cd,./FreeBSD-12.1-RELEASE-amd64-dvd1.iso bee +<<END LAYER 2 GUEST START>> + +Result is that Layer 1 - FreeBSD Host guest "paused". + +To Layer 1 machines freezes I cannot get any further diagnostics from this machine, so I run tail on libvirt log from Layer 0 - Ubuntu Host + +<<LAYER 0 LOG TAIL>> +char device redirected to /dev/pts/29 (label charserial0) +2020-05-04T06:09:15.310474Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] +2020-05-04T06:09:15.310531Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] +2020-05-04T06:09:15.312533Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] +2020-05-04T06:09:15.312548Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] +2020-05-04T06:09:15.313828Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] +2020-05-04T06:09:15.313841Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] +2020-05-04T06:09:15.315185Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(48FH).vmx-exit-load-perf-global-ctrl [bit 12] +2020-05-04T06:09:15.315201Z qemu-system-x86_64: warning: host doesn't support requested feature: MSR(490H).vmx-entry-load-perf-global-ctrl [bit 13] +KVM internal error. Suberror: 1 +emulation failure +EAX=00000000 EBX=00000000 ECX=00000000 EDX=00000000 +ESI=00000000 EDI=00000000 EBP=00000000 ESP=00000000 +EIP=00000000 EFL=00000000 [-------] CPL=0 II=0 A20=1 SMM=0 HLT=0 +ES =0000 00000000 00000000 00008000 DPL=0 <hiword> +CS =0000 00000000 00000000 00008000 DPL=0 <hiword> +SS =0000 00000000 00000000 00008000 DPL=0 <hiword> +DS =0000 00000000 00000000 00008000 DPL=0 <hiword> +FS =0000 00000000 00000000 00008000 DPL=0 <hiword> +GS =0000 00000000 00000000 00008000 DPL=0 <hiword> +LDT=0000 00000000 00000000 00008000 DPL=0 <hiword> +TR =0000 00000000 00000000 00008000 DPL=0 <hiword> +GDT= 0000000000000000 00000000 +IDT= 0000000000000000 00000000 +CR0=80050033 CR2=0000000000000000 CR3=0000000000000000 CR4=00372060 +DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 +DR6=00000000ffff0ff0 DR7=0000000000000400 +EFER=0000000000000d01 +Code=<??> ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? ?? +2020-05-04T06:35:39.186799Z qemu-system-x86_64: terminating on signal 15 from pid 2155 (/usr/sbin/libvirtd) +2020-05-04 06:35:39.386+0000: shutting down, reason=destroyed +<<END LAYER 0 LOG TAIL>> + + +I am reporting this bug here as result is very similar to that seen with QEMU seabios failure reported here: https://bugs.launchpad.net/qemu/+bug/1866870 + +However in this case my VM Layer 1 VM is using OVMF. + +NOTE 1: I have also tested with Q35 v3.1 and 2.12 and get the same result. +NOTE 2: Due to bug in FreeBSD networking code, I had to compile custom kernel with "netmap driver disabled". This is known bug in FreeBSD that I have reported separately. +NOTE 3: I will cross posted this bug report on FreeBSD bugzilla as well: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=246168 +NOTE 4: Have done extensive testing of Ubuntu 20.04 Nested virtualisation with just Ubuntu hosts and OVMF and the nested virtualisation runs correctly, so problem is specific to using FreeBSD / bhyve guest / host. \ No newline at end of file |