The guest paused after living migration on destination host, vm-entry error code 0x80000021 Description of problem: The guest start on source host, then living migration to destination host, the guest status is pausing. source host CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz destination host CPU: Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz If the guest migration from E5-2650 to Silver 4114, the guest runs normally without pausing. Steps to reproduce: 1. start guest, on source host, host CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz. 2. living migration guest to destination host, host CPU: Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz. 3. migration finished, the guest pausing. Additional information: /label ~"kind::Bug" qemu log: ``` KVM: entry failed, hardware error 0x80000021 If you're running a guest on an Intel machine without unrestricted mode support, the failure can be most likely due to the guest entering an invalid state for Intel VT. For example, the guest maybe running in big real mode which is not supported on less recent Intel processors. EAX=94d14da0 EBX=95341e20 ECX=00000000 EDX=00000000 ESI=00000000 EDI=00000046 EBP=95203eb0 ESP=95203eb0 EIP=94d14f76 EFL=00000286 [--S--P-] CPL=0 II=0 A20=1 SMM=0 HLT=0 ES =0000 00000000 0000ffff 00009300 CS =f000 ffff0000 0000ffff 00009b00 SS =0000 00000000 0000ffff 00009300 DS =0000 00000000 0000ffff 00009300 FS =0000 00000000 0000ffff 00009300 GS =0000 00000000 0000ffff 00009300 LDT=0000 00000000 0000ffff 00008200 TR =0000 00000000 0000ffff 00008b00 GDT= 00000000 0000ffff IDT= 00000000 0000ffff CR0=60000010 CR2=00000000 CR3=00000000 CR4=00000000 DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 DR6=00000000ffff0ff0 DR7=0000000000000400 EFER=0000000000000000 Code=00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ``` host log: ``` kernel: [228693.951391] *** Guest State *** kernel: [228693.951411] CR0: actual=0x0000000000000030, shadow=0x0000000060000010, gh_mask=fffffffffffffff7 kernel: [228693.951422] CR4: actual=0x0000000000002040, shadow=0x0000000000000000, gh_mask=fffffffffffff871 kernel: [228693.951430] CR3 = 0x0000000000000000 kernel: [228693.951437] PDPTR0 = 0x0000000000000000 PDPTR1 = 0x0000000000000000 kernel: [228693.951445] PDPTR2 = 0x0000000000000000 PDPTR3 = 0x0000000000000000 kernel: [228693.951452] RSP = 0xffffffff95203eb0 RIP = 0xffffffff94d14f76 kernel: [228693.951459] RFLAGS=0x00000286 DR7 = 0x0000000000000400 kernel: [228693.951467] Sysenter RSP=0000000000000000 CS:RIP=0000:0000000000000000 kernel: [228693.951476] CS: sel=0xf000, attr=0x0009b, limit=0x0000ffff, base=0x00000000ffff0000 kernel: [228693.951485] DS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951494] SS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951502] ES: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951510] FS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951519] GS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951527] GDTR: limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951537] LDTR: sel=0x0000, attr=0x00082, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951545] IDTR: limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951553] TR: sel=0x0000, attr=0x0008b, limit=0x0000ffff, base=0x0000000000000000 kernel: [228693.951562] EFER = 0x0000000000000000 PAT = 0x0007040600070406 kernel: [228693.951569] DebugCtl = 0x0000000000000000 DebugExceptions = 0x0000000000000000 kernel: [228693.951578] Interruptibility = 00000000 ActivityState = 00000000 kernel: [228693.951586] InterruptStatus = 00b1 kernel: [228693.951591] *** Host State *** kernel: [228693.951597] RIP = 0xffffffffc4b064ff RSP = 0xffffaf14ccf87d10 kernel: [228693.951606] CS=0010 SS=0018 DS=0000 ES=0000 FS=0000 GS=0000 TR=0040 kernel: [228693.951614] FSBase=00007f0b2657a640 GSBase=ffff9c083f580000 TRBase=fffffe00001a0000 kernel: [228693.951623] GDTBase=fffffe000019e000 IDTBase=fffffe0000000000 kernel: [228693.951631] CR0=0000000080050033 CR3=000000029800c004 CR4=00000000003726e0 kernel: [228693.951639] Sysenter RSP=fffffe00001a0000 CS:RIP=0010:ffffffff95801590 kernel: [228693.951648] EFER = 0x0000000000000d01 PAT = 0x0407050600070106 kernel: [228693.951655] *** Control State *** kernel: [228693.951662] CPUBased=0xb5a06dfa SecondaryExec=0x00032ff2 TertiaryExec=0x0000000000000000 kernel: [228693.951671] PinBased=0x000000ff EntryControls=0000d1ff ExitControls=002befff kernel: [228693.951679] ExceptionBitmap=00060042 PFECmask=00000000 PFECmatch=00000000 kernel: [228693.951686] VMEntry: intr_info=00000000 errcode=00000000 ilen=00000000 kernel: [228693.951695] VMExit: intr_info=00000000 errcode=00000000 ilen=00000000 kernel: [228693.951702] reason=80000021 qualification=0000000000000000 kernel: [228693.951709] IDTVectoring: info=00000000 errcode=00000000 kernel: [228693.951717] TSC Offset = 0xfffe2c437c9ab552 kernel: [228693.951724] SVI|RVI = 00|b1 TPR Threshold = 0x00 kernel: [228693.951734] virt-APIC addr = 0x00000002a3014000 kernel: [228693.951736] PostedIntrVec = 0xf2 kernel: [228693.951743] EPT pointer = 0x000000012dfe705e kernel: [228693.951749] PLE Gap=00000080 Window=00001000 kernel: [228693.951755] Virtual processor ID = 0x0009 ```