2022-01-29T04:59:38.018 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-29T04:59:38.145 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging 2022-01-29T04:59:38.146 INFO:teuthology.lock.ops:Updating [ubuntu@smithi073.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T04:59:38.146 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-01-29T04:59:38.169 INFO:teuthology.lock.ops:Node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging is complete 2022-01-29T04:59:38.169 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging 2022-01-29T04:59:38.170 INFO:teuthology.lock.ops:Updating [ubuntu@smithi090.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T04:59:38.170 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2022-01-29T04:59:38.191 INFO:teuthology.lock.ops:Node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging is complete 2022-01-29T04:59:38.376 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.3 2022-01-29T04:59:38.398 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.3 2022-01-29T04:59:38.682 INFO:teuthology.orchestra.console:Power off smithi073 2022-01-29T04:59:38.720 INFO:teuthology.orchestra.console:Power off smithi090 2022-01-29T04:59:51.171 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-01-29T04:59:51.189 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2022-01-29T04:59:51.273 INFO:teuthology.orchestra.console:Power on smithi073 2022-01-29T04:59:51.290 INFO:teuthology.orchestra.console:Power on smithi090 2022-01-29T04:59:55.539 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2022-01-29T04:59:55.640 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2022-01-29T04:59:59.644 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2022-01-29T04:59:59.745 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2022-01-29T05:04:28.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T05:04:28.855 INFO:teuthology.provision.fog.smithi073:Node is ready 2022-01-29T05:04:28.872 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2022-01-29T05:04:28.929 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2022-01-29T05:04:29.265 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2022-01-29T05:05:12.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T05:05:13.222 INFO:teuthology.provision.fog.smithi090:Node is ready 2022-01-29T05:05:13.237 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2022-01-29T05:05:13.292 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2022-01-29T05:05:13.617 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2022-01-29T05:05:13.764 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2022-01-29T05:05:13.765 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T05:05:13.785 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2022-01-29T05:05:13.785 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T05:05:13.807 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2022-01-29T05:05:13.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-01-29T05:05:14.076 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2022-01-29T05:05:14.131 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Linux" 2022-01-29T05:05:14.131 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2022-01-29T05:05:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2022-01-29T05:05:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2022-01-29T05:05:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2022-01-29T05:05:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2022-01-29T05:05:14.133 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-29T05:05:14.133 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2022-01-29T05:05:14.133 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T05:05:14.133 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2022-01-29T05:05:14.133 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T05:05:14.134 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T05:05:14.134 INFO:teuthology.orchestra.run.smithi073.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T05:05:14.135 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-01-29T05:05:14.154 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2022-01-29T05:05:14.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2022-01-29T05:05:14.414 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2022-01-29T05:05:14.468 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Linux" 2022-01-29T05:05:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2022-01-29T05:05:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2022-01-29T05:05:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2022-01-29T05:05:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2022-01-29T05:05:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2022-01-29T05:05:14.470 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-29T05:05:14.470 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2022-01-29T05:05:14.470 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T05:05:14.470 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2022-01-29T05:05:14.471 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T05:05:14.471 INFO:teuthology.orchestra.run.smithi090.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T05:05:14.471 INFO:teuthology.orchestra.run.smithi090.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T05:05:14.472 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2022-01-29T05:05:14.569 INFO:teuthology.dispatcher.supervisor:Running job 6647226 2022-01-29T05:05:14.570 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-28_20:41:38-rbd-wip-yuri4-testing-2022-01-28-0943-quincy-distro-default-smithi/6647226 --name yuriw-2022-01-28_20:41:38-rbd-wip-yuri4-testing-2022-01-28-0943-quincy-distro-default-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/yuriw-2022-01-28_20:41:38-rbd-wip-yuri4-testing-2022-01-28-0943-quincy-distro-default-smithi/6647226/orig.config.yaml 2022-01-29T05:05:14.575 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-28_20:41:38-rbd-wip-yuri4-testing-2022-01-28-0943-quincy-distro-default-smithi/6647226 2022-01-29T05:05:14.575 INFO:teuthology.dispatcher.supervisor:Job PID: 7191 2022-01-29T05:05:14.576 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-29T11:35:43.415 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-29T11:35:43.571 INFO:teuthology.kill:Killing Pids: {7191} 2022-01-29T11:35:44.791 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2022-01-29T11:35:44.792 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2022-01-29T11:35:44.792 INFO:teuthology.misc:Compressing logs... 2022-01-29T11:35:44.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-01-29T11:35:45.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2022-01-29T11:35:45.567 INFO:teuthology.misc:Compressing logs... 2022-01-29T11:35:45.726 INFO:teuthology.misc:Compressing logs... 2022-01-29T11:37:44.993 INFO:teuthology.kill:No teuthology processes running 2022-01-29T11:37:46.218 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi090'] 2022-01-29T11:37:47.243 INFO:teuthology.kill:2022-01-29 11:37:47,242.242 INFO:teuthology.nuke:targets: 2022-01-29T11:37:47.243 INFO:teuthology.kill: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDH/7F7RG5TWwHTUzRhEmSHJMpTX76jnNeOetGR84yVBX+CLWToAUvEgRbpZx+fBP5oL9WNKjbSKlscl70Oi/vooCj7tFU4byihVP/q1Tq42qErdh2rBjanFPDbgDWOUMXXzlDpZYlomzvHqA27EfzAeI/8pVA40JXYO2cqXnc8DbDpNRXgsiQPpSywQQ+Q9iKZoRf1xW5gmNd1TlxBdhaxl6U8nhSAxwdPYtD7rKJg9xFA6dLIujVF8o8NfCYp3dawabNOtyddq+Ce+7sLsYramsXDAViJuBGtWcZlm1PNVdoAg6Jr+IIAAjnX6Jtgslf++th2/H+9/k2ONyLxmvPsE/D2RpYr8dK60NCrmVDfPBbUeePqq/zvKy3CCUBimibx1ESHXAYrY2ERDr2x9bXxOdE+sVtHjVuY48kvx43ZQOXkTzl53/qywGo9Dcvsi73TNA3r0FLeNEwHVRx63pL7d7rPoU4EIf7a64eiQ6e2WBSKYFimwhfwQIoQF9lz6NE= 2022-01-29T11:37:47.244 INFO:teuthology.kill: smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqS4QitW+FgUqErbuXF9v+Ljt8pphNHFBaPyPlcmByfpxQBDcGX+xv0G/PyEUBAzhf1Jrdva+CJZdepWd6dpYSic3iserZR2qRVzyY9yeuQPcnlcOdIPbcRoU6h3J4yg9oQluVhBKTf4qOFBVuBixZuTwAL8KTKlznYtgFGvY+pxvFPknWg83fTS1rnBT+kgCGQPVYTUmWdUsAqX6ll9SshlMvYfhHm8GJlh5wxPqML9yMNOVp2ELWO+MNims6Wq67peiOAUtbHbp5izwQEJfJLYeCR5g0MgFNUs5pX6GOY3vaIkKur3YxBhgUHjziHq5UnQBbrSjvuh12PMkSRYoyVRWbPCPHxklLT5RbT64hMzci/Nxulr1DZrAQowhVXhd/8sC/WmqjcBTWJW28w2ecm1wAujFkmHqLOklsp7LjFX96NE2+nBM7A9yuDqc+BPrh4OFKVOYzR+Ie3qyS+3BzJxrWAMPt4sQviLJr9U37DigDCS5C20hiew6eg83exD8= 2022-01-29T11:37:47.275 INFO:teuthology.kill:2022-01-29 11:37:47,273.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T11:37:47.276 INFO:teuthology.kill:2022-01-29 11:37:47,276.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T11:37:47.364 INFO:teuthology.kill:2022-01-29 11:37:47,363.363 INFO:teuthology.orchestra.console:Power off smithi090 2022-01-29T11:37:47.385 INFO:teuthology.kill:2022-01-29 11:37:47,384.384 INFO:teuthology.orchestra.console:Power off smithi073 2022-01-29T11:37:55.744 INFO:teuthology.kill:2022-01-29 11:37:55,744.744 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2022-01-29T11:37:55.896 INFO:teuthology.kill:2022-01-29 11:37:55,896.896 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2022-01-29T11:37:59.864 INFO:teuthology.kill:2022-01-29 11:37:59,863.863 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-01-29T11:38:00.011 INFO:teuthology.kill:2022-01-29 11:38:00,011.011 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2022-01-29T11:40:00.366 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-29T11:40:00.479 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647658 2022-01-29T11:40:00.480 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647658