1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
|
other: 0.869
instruction: 0.794
semantic: 0.770
network: 0.708
mistranslation: 0.693
KVM: 0.669
boot: 0.658
[Qemu-devel] 答复: Re: [BUG]COLO failover hang
hi.
I test the git qemu master have the same problem.
(gdb) bt
#0 qio_channel_socket_readv (ioc=0x7f65911b4e50, iov=0x7f64ef3fd880, niov=1,
fds=0x0, nfds=0x0, errp=0x0) at io/channel-socket.c:461
#1 0x00007f658e4aa0c2 in qio_channel_read (address@hidden, address@hidden "",
address@hidden, address@hidden) at io/channel.c:114
#2 0x00007f658e3ea990 in channel_get_buffer (opaque=ï¼optimized outï¼,
buf=0x7f65907cb838 "", pos=ï¼optimized outï¼, size=32768) at
migration/qemu-file-channel.c:78
#3 0x00007f658e3e97fc in qemu_fill_buffer (f=0x7f65907cb800) at
migration/qemu-file.c:295
#4 0x00007f658e3ea2e1 in qemu_peek_byte (address@hidden, address@hidden) at
migration/qemu-file.c:555
#5 0x00007f658e3ea34b in qemu_get_byte (address@hidden) at
migration/qemu-file.c:568
#6 0x00007f658e3ea552 in qemu_get_be32 (address@hidden) at
migration/qemu-file.c:648
#7 0x00007f658e3e66e5 in colo_receive_message (f=0x7f65907cb800,
address@hidden) at migration/colo.c:244
#8 0x00007f658e3e681e in colo_receive_check_message (f=ï¼optimized outï¼,
address@hidden, address@hidden)
at migration/colo.c:264
#9 0x00007f658e3e740e in colo_process_incoming_thread (opaque=0x7f658eb30360
ï¼mis_current.31286ï¼) at migration/colo.c:577
#10 0x00007f658be09df3 in start_thread () from /lib64/libpthread.so.0
#11 0x00007f65881983ed in clone () from /lib64/libc.so.6
(gdb) p ioc-ï¼name
$2 = 0x7f658ff7d5c0 "migration-socket-incoming"
(gdb) p ioc-ï¼features Do not support QIO_CHANNEL_FEATURE_SHUTDOWN
$3 = 0
(gdb) bt
#0 socket_accept_incoming_migration (ioc=0x7fdcceeafa90, condition=G_IO_IN,
opaque=0x7fdcceeafa90) at migration/socket.c:137
#1 0x00007fdcc6966350 in g_main_dispatch (context=ï¼optimized outï¼) at
gmain.c:3054
#2 g_main_context_dispatch (context=ï¼optimized outï¼, address@hidden) at
gmain.c:3630
#3 0x00007fdccb8a6dcc in glib_pollfds_poll () at util/main-loop.c:213
#4 os_host_main_loop_wait (timeout=ï¼optimized outï¼) at util/main-loop.c:258
#5 main_loop_wait (address@hidden) at util/main-loop.c:506
#6 0x00007fdccb526187 in main_loop () at vl.c:1898
#7 main (argc=ï¼optimized outï¼, argv=ï¼optimized outï¼, envp=ï¼optimized outï¼) at
vl.c:4709
(gdb) p ioc-ï¼features
$1 = 6
(gdb) p ioc-ï¼name
$2 = 0x7fdcce1b1ab0 "migration-socket-listener"
May be socket_accept_incoming_migration should call
qio_channel_set_feature(ioc, QIO_CHANNEL_FEATURE_SHUTDOWN)??
thank you.
åå§é®ä»¶
åä»¶äººï¼ address@hidden
æ¶ä»¶äººï¼ç广10165992 address@hidden
æéäººï¼ address@hidden address@hidden
æ¥ æ ï¼2017å¹´03æ16æ¥ 14:46
主 é¢ ï¼Re: [Qemu-devel] COLO failover hang
On 03/15/2017 05:06 PM, wangguang wrote:
ï¼ am testing QEMU COLO feature described here [QEMU
ï¼ Wiki](
http://wiki.qemu-project.org/Features/COLO
).
ï¼
ï¼ When the Primary Node panic,the Secondary Node qemu hang.
ï¼ hang at recvmsg in qio_channel_socket_readv.
ï¼ And I run { 'execute': 'nbd-server-stop' } and { "execute":
ï¼ "x-colo-lost-heartbeat" } in Secondary VM's
ï¼ monitor,the Secondary Node qemu still hang at recvmsg .
ï¼
ï¼ I found that the colo in qemu is not complete yet.
ï¼ Do the colo have any plan for development?
Yes, We are developing. You can see some of patch we pushing.
ï¼ Has anyone ever run it successfully? Any help is appreciated!
In our internal version can run it successfully,
The failover detail you can ask Zhanghailiang for help.
Next time if you have some question about COLO,
please cc me and zhanghailiang address@hidden
Thanks
Zhang Chen
ï¼
ï¼
ï¼
ï¼ centos7.2+qemu2.7.50
ï¼ (gdb) bt
ï¼ #0 0x00007f3e00cc86ad in recvmsg () from /lib64/libpthread.so.0
ï¼ #1 0x00007f3e0332b738 in qio_channel_socket_readv (ioc=ï¼optimized outï¼,
ï¼ iov=ï¼optimized outï¼, niov=ï¼optimized outï¼, fds=0x0, nfds=0x0, errp=0x0) at
ï¼ io/channel-socket.c:497
ï¼ #2 0x00007f3e03329472 in qio_channel_read (address@hidden,
ï¼ address@hidden "", address@hidden,
ï¼ address@hidden) at io/channel.c:97
ï¼ #3 0x00007f3e032750e0 in channel_get_buffer (opaque=ï¼optimized outï¼,
ï¼ buf=0x7f3e05910f38 "", pos=ï¼optimized outï¼, size=32768) at
ï¼ migration/qemu-file-channel.c:78
ï¼ #4 0x00007f3e0327412c in qemu_fill_buffer (f=0x7f3e05910f00) at
ï¼ migration/qemu-file.c:257
ï¼ #5 0x00007f3e03274a41 in qemu_peek_byte (address@hidden,
ï¼ address@hidden) at migration/qemu-file.c:510
ï¼ #6 0x00007f3e03274aab in qemu_get_byte (address@hidden) at
ï¼ migration/qemu-file.c:523
ï¼ #7 0x00007f3e03274cb2 in qemu_get_be32 (address@hidden) at
ï¼ migration/qemu-file.c:603
ï¼ #8 0x00007f3e03271735 in colo_receive_message (f=0x7f3e05910f00,
ï¼ address@hidden) at migration/colo.c:215
ï¼ #9 0x00007f3e0327250d in colo_wait_handle_message (errp=0x7f3d62bfaa48,
ï¼ checkpoint_request=ï¼synthetic pointerï¼, f=ï¼optimized outï¼) at
ï¼ migration/colo.c:546
ï¼ #10 colo_process_incoming_thread (opaque=0x7f3e067245e0) at
ï¼ migration/colo.c:649
ï¼ #11 0x00007f3e00cc1df3 in start_thread () from /lib64/libpthread.so.0
ï¼ #12 0x00007f3dfc9c03ed in clone () from /lib64/libc.so.6
ï¼
ï¼
ï¼
ï¼
ï¼
ï¼ --
ï¼ View this message in context:
http://qemu.11.n7.nabble.com/COLO-failover-hang-tp473250.html
ï¼ Sent from the Developer mailing list archive at Nabble.com.
ï¼
ï¼
ï¼
ï¼
--
Thanks
Zhang Chen
Hi,Wang.
You can test this branch:
https://github.com/coloft/qemu/tree/colo-v5.1-developing-COLO-frame-v21-with-shared-disk
and please follow wiki ensure your own configuration correctly.
http://wiki.qemu-project.org/Features/COLO
Thanks
Zhang Chen
On 03/21/2017 03:27 PM, address@hidden wrote:
hi.
I test the git qemu master have the same problem.
(gdb) bt
#0 qio_channel_socket_readv (ioc=0x7f65911b4e50, iov=0x7f64ef3fd880,
niov=1, fds=0x0, nfds=0x0, errp=0x0) at io/channel-socket.c:461
#1 0x00007f658e4aa0c2 in qio_channel_read
(address@hidden, address@hidden "",
address@hidden, address@hidden) at io/channel.c:114
#2 0x00007f658e3ea990 in channel_get_buffer (opaque=ï¼optimized outï¼,
buf=0x7f65907cb838 "", pos=ï¼optimized outï¼, size=32768) at
migration/qemu-file-channel.c:78
#3 0x00007f658e3e97fc in qemu_fill_buffer (f=0x7f65907cb800) at
migration/qemu-file.c:295
#4 0x00007f658e3ea2e1 in qemu_peek_byte (address@hidden,
address@hidden) at migration/qemu-file.c:555
#5 0x00007f658e3ea34b in qemu_get_byte (address@hidden) at
migration/qemu-file.c:568
#6 0x00007f658e3ea552 in qemu_get_be32 (address@hidden) at
migration/qemu-file.c:648
#7 0x00007f658e3e66e5 in colo_receive_message (f=0x7f65907cb800,
address@hidden) at migration/colo.c:244
#8 0x00007f658e3e681e in colo_receive_check_message (f=ï¼optimized
outï¼, address@hidden,
address@hidden)
at migration/colo.c:264
#9 0x00007f658e3e740e in colo_process_incoming_thread
(opaque=0x7f658eb30360 ï¼mis_current.31286ï¼) at migration/colo.c:577
#10 0x00007f658be09df3 in start_thread () from /lib64/libpthread.so.0
#11 0x00007f65881983ed in clone () from /lib64/libc.so.6
(gdb) p ioc-ï¼name
$2 = 0x7f658ff7d5c0 "migration-socket-incoming"
(gdb) p ioc-ï¼features Do not support QIO_CHANNEL_FEATURE_SHUTDOWN
$3 = 0
(gdb) bt
#0 socket_accept_incoming_migration (ioc=0x7fdcceeafa90,
condition=G_IO_IN, opaque=0x7fdcceeafa90) at migration/socket.c:137
#1 0x00007fdcc6966350 in g_main_dispatch (context=ï¼optimized outï¼) at
gmain.c:3054
#2 g_main_context_dispatch (context=ï¼optimized outï¼,
address@hidden) at gmain.c:3630
#3 0x00007fdccb8a6dcc in glib_pollfds_poll () at util/main-loop.c:213
#4 os_host_main_loop_wait (timeout=ï¼optimized outï¼) at
util/main-loop.c:258
#5 main_loop_wait (address@hidden) at
util/main-loop.c:506
#6 0x00007fdccb526187 in main_loop () at vl.c:1898
#7 main (argc=ï¼optimized outï¼, argv=ï¼optimized outï¼, envp=ï¼optimized
outï¼) at vl.c:4709
(gdb) p ioc-ï¼features
$1 = 6
(gdb) p ioc-ï¼name
$2 = 0x7fdcce1b1ab0 "migration-socket-listener"
May be socket_accept_incoming_migration should
call qio_channel_set_feature(ioc, QIO_CHANNEL_FEATURE_SHUTDOWN)??
thank you.
åå§é®ä»¶
address@hidden;
*æ¶ä»¶äººï¼*ç广10165992;address@hidden;
address@hidden;address@hidden;
*æ¥ æ ï¼*2017å¹´03æ16æ¥ 14:46
*主 é¢ ï¼**Re: [Qemu-devel] COLO failover hang*
On 03/15/2017 05:06 PM, wangguang wrote:
ï¼ am testing QEMU COLO feature described here [QEMU
ï¼ Wiki](
http://wiki.qemu-project.org/Features/COLO
).
ï¼
ï¼ When the Primary Node panic,the Secondary Node qemu hang.
ï¼ hang at recvmsg in qio_channel_socket_readv.
ï¼ And I run { 'execute': 'nbd-server-stop' } and { "execute":
ï¼ "x-colo-lost-heartbeat" } in Secondary VM's
ï¼ monitor,the Secondary Node qemu still hang at recvmsg .
ï¼
ï¼ I found that the colo in qemu is not complete yet.
ï¼ Do the colo have any plan for development?
Yes, We are developing. You can see some of patch we pushing.
ï¼ Has anyone ever run it successfully? Any help is appreciated!
In our internal version can run it successfully,
The failover detail you can ask Zhanghailiang for help.
Next time if you have some question about COLO,
please cc me and zhanghailiang address@hidden
Thanks
Zhang Chen
ï¼
ï¼
ï¼
ï¼ centos7.2+qemu2.7.50
ï¼ (gdb) bt
ï¼ #0 0x00007f3e00cc86ad in recvmsg () from /lib64/libpthread.so.0
ï¼ #1 0x00007f3e0332b738 in qio_channel_socket_readv (ioc=ï¼optimized outï¼,
ï¼ iov=ï¼optimized outï¼, niov=ï¼optimized outï¼, fds=0x0, nfds=0x0, errp=0x0) at
ï¼ io/channel-socket.c:497
ï¼ #2 0x00007f3e03329472 in qio_channel_read (address@hidden,
ï¼ address@hidden "", address@hidden,
ï¼ address@hidden) at io/channel.c:97
ï¼ #3 0x00007f3e032750e0 in channel_get_buffer (opaque=ï¼optimized outï¼,
ï¼ buf=0x7f3e05910f38 "", pos=ï¼optimized outï¼, size=32768) at
ï¼ migration/qemu-file-channel.c:78
ï¼ #4 0x00007f3e0327412c in qemu_fill_buffer (f=0x7f3e05910f00) at
ï¼ migration/qemu-file.c:257
ï¼ #5 0x00007f3e03274a41 in qemu_peek_byte (address@hidden,
ï¼ address@hidden) at migration/qemu-file.c:510
ï¼ #6 0x00007f3e03274aab in qemu_get_byte (address@hidden) at
ï¼ migration/qemu-file.c:523
ï¼ #7 0x00007f3e03274cb2 in qemu_get_be32 (address@hidden) at
ï¼ migration/qemu-file.c:603
ï¼ #8 0x00007f3e03271735 in colo_receive_message (f=0x7f3e05910f00,
ï¼ address@hidden) at migration/colo.c:215
ï¼ #9 0x00007f3e0327250d in colo_wait_handle_message (errp=0x7f3d62bfaa48,
ï¼ checkpoint_request=ï¼synthetic pointerï¼, f=ï¼optimized outï¼) at
ï¼ migration/colo.c:546
ï¼ #10 colo_process_incoming_thread (opaque=0x7f3e067245e0) at
ï¼ migration/colo.c:649
ï¼ #11 0x00007f3e00cc1df3 in start_thread () from /lib64/libpthread.so.0
ï¼ #12 0x00007f3dfc9c03ed in clone () from /lib64/libc.so.6
ï¼
ï¼
ï¼
ï¼
ï¼
ï¼ --
ï¼ View this message in context:
http://qemu.11.n7.nabble.com/COLO-failover-hang-tp473250.html
ï¼ Sent from the Developer mailing list archive at Nabble.com.
ï¼
ï¼
ï¼
ï¼
--
Thanks
Zhang Chen
--
Thanks
Zhang Chen
|