1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
|
The guest paused after living migration on destination host, vm-entry error code 0x80000021
Description of problem:
The guest start on source host, then living migration to destination host, the guest status is pausing.
source host CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz
destination host CPU: Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
If the guest migration from E5-2650 to Silver 4114, the guest runs normally without pausing.
Steps to reproduce:
1. start guest, on source host, host CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz.
2. living migration guest to destination host, host CPU: Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz.
3. migration finished, the guest pausing.
Additional information:
/label ~"kind::Bug"
qemu log:
```
KVM: entry failed, hardware error 0x80000021
If you're running a guest on an Intel machine without unrestricted mode
support, the failure can be most likely due to the guest entering an invalid
state for Intel VT. For example, the guest maybe running in big real mode
which is not supported on less recent Intel processors.
EAX=94d14da0 EBX=95341e20 ECX=00000000 EDX=00000000
ESI=00000000 EDI=00000046 EBP=95203eb0 ESP=95203eb0
EIP=94d14f76 EFL=00000286 [--S--P-] CPL=0 II=0 A20=1 SMM=0 HLT=0
ES =0000 00000000 0000ffff 00009300
CS =f000 ffff0000 0000ffff 00009b00
SS =0000 00000000 0000ffff 00009300
DS =0000 00000000 0000ffff 00009300
FS =0000 00000000 0000ffff 00009300
GS =0000 00000000 0000ffff 00009300
LDT=0000 00000000 0000ffff 00008200
TR =0000 00000000 0000ffff 00008b00
GDT= 00000000 0000ffff
IDT= 00000000 0000ffff
CR0=60000010 CR2=00000000 CR3=00000000 CR4=00000000
DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000
DR6=00000000ffff0ff0 DR7=0000000000000400
EFER=0000000000000000
Code=00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
```
host log:
```
kernel: [228693.951391] *** Guest State ***
kernel: [228693.951411] CR0: actual=0x0000000000000030, shadow=0x0000000060000010, gh_mask=fffffffffffffff7
kernel: [228693.951422] CR4: actual=0x0000000000002040, shadow=0x0000000000000000, gh_mask=fffffffffffff871
kernel: [228693.951430] CR3 = 0x0000000000000000
kernel: [228693.951437] PDPTR0 = 0x0000000000000000 PDPTR1 = 0x0000000000000000
kernel: [228693.951445] PDPTR2 = 0x0000000000000000 PDPTR3 = 0x0000000000000000
kernel: [228693.951452] RSP = 0xffffffff95203eb0 RIP = 0xffffffff94d14f76
kernel: [228693.951459] RFLAGS=0x00000286 DR7 = 0x0000000000000400
kernel: [228693.951467] Sysenter RSP=0000000000000000 CS:RIP=0000:0000000000000000
kernel: [228693.951476] CS: sel=0xf000, attr=0x0009b, limit=0x0000ffff, base=0x00000000ffff0000
kernel: [228693.951485] DS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951494] SS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951502] ES: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951510] FS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951519] GS: sel=0x0000, attr=0x00093, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951527] GDTR: limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951537] LDTR: sel=0x0000, attr=0x00082, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951545] IDTR: limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951553] TR: sel=0x0000, attr=0x0008b, limit=0x0000ffff, base=0x0000000000000000
kernel: [228693.951562] EFER = 0x0000000000000000 PAT = 0x0007040600070406
kernel: [228693.951569] DebugCtl = 0x0000000000000000 DebugExceptions = 0x0000000000000000
kernel: [228693.951578] Interruptibility = 00000000 ActivityState = 00000000
kernel: [228693.951586] InterruptStatus = 00b1
kernel: [228693.951591] *** Host State ***
kernel: [228693.951597] RIP = 0xffffffffc4b064ff RSP = 0xffffaf14ccf87d10
kernel: [228693.951606] CS=0010 SS=0018 DS=0000 ES=0000 FS=0000 GS=0000 TR=0040
kernel: [228693.951614] FSBase=00007f0b2657a640 GSBase=ffff9c083f580000 TRBase=fffffe00001a0000
kernel: [228693.951623] GDTBase=fffffe000019e000 IDTBase=fffffe0000000000
kernel: [228693.951631] CR0=0000000080050033 CR3=000000029800c004 CR4=00000000003726e0
kernel: [228693.951639] Sysenter RSP=fffffe00001a0000 CS:RIP=0010:ffffffff95801590
kernel: [228693.951648] EFER = 0x0000000000000d01 PAT = 0x0407050600070106
kernel: [228693.951655] *** Control State ***
kernel: [228693.951662] CPUBased=0xb5a06dfa SecondaryExec=0x00032ff2 TertiaryExec=0x0000000000000000
kernel: [228693.951671] PinBased=0x000000ff EntryControls=0000d1ff ExitControls=002befff
kernel: [228693.951679] ExceptionBitmap=00060042 PFECmask=00000000 PFECmatch=00000000
kernel: [228693.951686] VMEntry: intr_info=00000000 errcode=00000000 ilen=00000000
kernel: [228693.951695] VMExit: intr_info=00000000 errcode=00000000 ilen=00000000
kernel: [228693.951702] reason=80000021 qualification=0000000000000000
kernel: [228693.951709] IDTVectoring: info=00000000 errcode=00000000
kernel: [228693.951717] TSC Offset = 0xfffe2c437c9ab552
kernel: [228693.951724] SVI|RVI = 00|b1 TPR Threshold = 0x00
kernel: [228693.951734] virt-APIC addr = 0x00000002a3014000
kernel: [228693.951736] PostedIntrVec = 0xf2
kernel: [228693.951743] EPT pointer = 0x000000012dfe705e
kernel: [228693.951749] PLE Gap=00000080 Window=00001000
kernel: [228693.951755] Virtual processor ID = 0x0009
```
|