2022-01-15T08:17:21.554 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-15T08:17:21.684 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging
2022-01-15T08:17:21.686 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T08:17:21.686 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-01-15T08:17:21.707 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete
2022-01-15T08:17:21.708 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging
2022-01-15T08:17:21.708 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T08:17:21.709 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2022-01-15T08:17:21.728 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete
2022-01-15T08:17:21.915 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream
2022-01-15T08:17:21.949 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2022-01-15T08:17:22.284 INFO:teuthology.orchestra.console:Power off smithi196
2022-01-15T08:17:22.300 INFO:teuthology.orchestra.console:Power off smithi050
2022-01-15T08:17:30.667 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2022-01-15T08:17:30.673 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-01-15T08:17:30.769 INFO:teuthology.orchestra.console:Power on smithi196
2022-01-15T08:17:30.777 INFO:teuthology.orchestra.console:Power on smithi050
2022-01-15T08:17:39.149 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2022-01-15T08:17:39.150 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2022-01-15T08:17:39.250 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2022-01-15T08:17:39.253 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2022-01-15T08:21:51.543 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T08:22:12.131 INFO:teuthology.provision.fog.smithi196:Node is ready
2022-01-15T08:22:12.152 INFO:teuthology.orchestra.run.smithi196.stdout:smithi126
2022-01-15T08:22:12.211 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.126 smithi126.front.sepia.ceph.com smithi126
2022-01-15T08:22:12.632 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2022-01-15T08:22:13.857 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T08:22:14.147 INFO:teuthology.provision.fog.smithi050:Node is ready
2022-01-15T08:22:14.165 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2022-01-15T08:22:14.223 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2022-01-15T08:22:14.564 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2022-01-15T08:22:14.742 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2022-01-15T08:22:14.743 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T08:22:14.762 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2022-01-15T08:22:14.763 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T08:22:14.784 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2022-01-15T08:22:14.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-01-15T08:22:14.976 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2022-01-15T08:22:15.034 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2022-01-15T08:22:15.034 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2022-01-15T08:22:15.035 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2022-01-15T08:22:15.035 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2022-01-15T08:22:15.035 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2022-01-15T08:22:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2022-01-15T08:22:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-15T08:22:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2022-01-15T08:22:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-15T08:22:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2022-01-15T08:22:15.037 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T08:22:15.037 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T08:22:15.037 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-15T08:22:15.038 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-01-15T08:22:15.062 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2022-01-15T08:22:15.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2022-01-15T08:22:15.264 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2022-01-15T08:22:15.321 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2022-01-15T08:22:15.322 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2022-01-15T08:22:15.322 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2022-01-15T08:22:15.322 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2022-01-15T08:22:15.322 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2022-01-15T08:22:15.323 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2022-01-15T08:22:15.323 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-15T08:22:15.323 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2022-01-15T08:22:15.323 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-15T08:22:15.323 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2022-01-15T08:22:15.324 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T08:22:15.324 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T08:22:15.324 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-15T08:22:15.325 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2022-01-15T08:22:15.447 INFO:teuthology.dispatcher.supervisor:Running job 6619128
2022-01-15T08:22:15.448 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6619128 --name yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6619128/orig.config.yaml
2022-01-15T08:22:15.451 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6619128
2022-01-15T08:22:15.452 INFO:teuthology.dispatcher.supervisor:Job PID: 8493
2022-01-15T08:22:15.452 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-15T14:52:45.072 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-15T14:52:45.267 INFO:teuthology.kill:Killing Pids: {8493}
2022-01-15T14:52:46.429 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-01-15T14:52:46.430 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-01-15T14:52:46.430 INFO:teuthology.misc:Compressing logs...
2022-01-15T14:52:46.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-01-15T14:52:46.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2022-01-15T14:52:46.936 INFO:teuthology.misc:Compressing logs...
2022-01-15T14:52:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-15T14:52:47.822 INFO:teuthology.misc:Compressing logs...
2022-01-15T14:52:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mds.cephfs.smithi050.jjoowj.log: file size changed while zipping
2022-01-15T14:52:53.329 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mon.smithi196.log: file size changed while zipping
2022-01-15T14:53:17.778 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mds.cephfs.smithi196.rujxfe.log: file size changed while zipping
2022-01-15T14:53:25.953 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mds.cephfs.smithi050.fpgpdf.log: file size changed while zipping
2022-01-15T14:53:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mgr.smithi050.zcvpai.log: file size changed while zipping
2022-01-15T14:53:28.678 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-15T14:53:37.546 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-15T14:53:42.126 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-15T14:53:44.870 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mds.cephfs.smithi196.plexix.log: file size changed while zipping
2022-01-15T14:53:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-15T14:53:52.944 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-15T14:53:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-15T14:54:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/ccd6a0b6-75dd-11ec-8c32-001a4aab830c/ceph-mon.smithi050.log: file size changed while zipping
2022-01-15T14:54:36.443 INFO:teuthology.kill:No teuthology processes running
2022-01-15T14:54:37.589 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi196']
2022-01-15T14:54:38.561 INFO:teuthology.kill:2022-01-15 14:54:38,560.560 INFO:teuthology.nuke:targets:
2022-01-15T14:54:38.561 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfKC3VE5/fF27MmqQbPkheMVdYvRHo6waq6F5CYTL9eprbat03MQZM7b8oTShOiXO/hhNIue427wEWMuckca3aw3nXEm9Ja/Ym2drZIWCktr6CmdpvQobwrnMpD1q+ge6o1CiuaKqadi8NlbUHHttvWNQFgtjB35KKQIyOeB1RRMBJl+FiIUIlFB/MwDAy0Qers/TgPRtsJMUWyPlia4RA6stbueXYyvP//SSMloHMaiPpfKpCdVAy3O/CoT8IDB4H6sWHKpP4EdyywFE+wWzWlezYu0YVO+CsPu0Tsb73T1rPGABaB41R+wr4vDKIrALZ0W6SA2gs3Lb8kMTmTu+I6EW4Dn1qj50Gnq/jov0XCE0nIo24rEceHGUTN1KRpeM8/G0RA1+Twyw4gkGdNYjVEv47rHGk7QiQGg05EzyydlodPT9FbHpFzrX5ZTj2n3++CL5rn9UMHkdgiEhewrWZSoRSggK+Sd6U/2rwGrrY75R9QmqL95RLU5GClvy8mq8=
2022-01-15T14:54:38.562 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLaiFZ+aqsORvP8imxfPOiB9Eo1/RCvcQaeKQ8SDq5ZENN4WUnmStlAanaVt8CqcYJRJG5ovqUsIdhDBprs8sqs5ti9e/s1omzozz9B6+cFvUx0gxY/0oA0fk4DxX0ebXyp7/RvuwSweDH2IIJRKqzCQ+Ey70PuDhi+nYHuBhMeym0hkIWd+vVe6BIkUQDWAabODMgGVlogu4ApVODbRh0M5Zc+jht93MejfjdRb2nuBG72vjJAVGpx3+pfNhkI7yZ4NxqG3rGbYvhI0SlW+dn87ygHpJktMCvR54qfSiF6TfW1GCGxnoaTaSVGdyXtXs2/qahKiZ0MQ5igY4HPrp2lpsql88OrtoO28lb2ZEMJwj+8Rf1+951m19tb6p9AfeWcF6fuVyunTmae90QPU9WQ1VjtXvfylndL6YD006fVT6zU8t6zbrcHWwujGNOamArL1VVba7u1oygbVwfFrE35PmDdpPvIpTaDHJwlgWuV6DTimgAryW/LsxrTakS/FU=
2022-01-15T14:54:38.589 INFO:teuthology.kill:2022-01-15 14:54:38,589.589 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T14:54:38.593 INFO:teuthology.kill:2022-01-15 14:54:38,592.592 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T14:54:38.670 INFO:teuthology.kill:2022-01-15 14:54:38,669.669 INFO:teuthology.orchestra.console:Power off smithi050
2022-01-15T14:54:38.684 INFO:teuthology.kill:2022-01-15 14:54:38,684.684 INFO:teuthology.orchestra.console:Power off smithi196
2022-01-15T14:54:47.048 INFO:teuthology.kill:2022-01-15 14:54:47,048.048 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2022-01-15T14:54:47.201 INFO:teuthology.kill:2022-01-15 14:54:47,200.200 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2022-01-15T14:54:51.151 INFO:teuthology.kill:2022-01-15 14:54:51,151.151 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-01-15T14:54:51.297 INFO:teuthology.kill:2022-01-15 14:54:51,296.296 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2022-01-15T14:56:51.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-15T14:56:51.783 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-15_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6619753
2022-01-15T14:56:51.783 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi196 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-15_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6619753