2022-03-18T06:42:06.612 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T06:42:06.735 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging
2022-03-18T06:42:06.736 INFO:teuthology.lock.ops:Updating [ubuntu@smithi067.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T06:42:06.736 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2022-03-18T06:42:06.756 INFO:teuthology.lock.ops:Node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging is complete
2022-03-18T06:42:06.756 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging
2022-03-18T06:42:06.757 INFO:teuthology.lock.ops:Updating [ubuntu@smithi159.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T06:42:06.758 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2022-03-18T06:42:06.780 INFO:teuthology.lock.ops:Node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging is complete
2022-03-18T06:42:06.985 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream
2022-03-18T06:42:06.989 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.stream
2022-03-18T06:42:07.301 INFO:teuthology.orchestra.console:Power off smithi159
2022-03-18T06:42:07.319 INFO:teuthology.orchestra.console:Power off smithi067
2022-03-18T06:42:15.681 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2022-03-18T06:42:15.783 INFO:teuthology.orchestra.console:Power on smithi159
2022-03-18T06:42:19.800 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2022-03-18T06:42:19.903 INFO:teuthology.orchestra.console:Power on smithi067
2022-03-18T06:42:24.159 INFO:teuthology.orchestra.console:Power on for smithi159 completed
2022-03-18T06:42:24.165 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2022-03-18T06:42:24.261 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2022-03-18T06:42:24.265 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2022-03-18T06:46:36.468 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T06:47:02.071 INFO:teuthology.provision.fog.smithi067:Node is ready
2022-03-18T06:47:02.095 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2022-03-18T06:47:02.155 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2022-03-18T06:47:02.514 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2022-03-18T06:47:05.007 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T06:47:05.246 INFO:teuthology.provision.fog.smithi159:Node is ready
2022-03-18T06:47:05.304 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2022-03-18T06:47:05.362 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2022-03-18T06:47:05.699 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2022-03-18T06:47:05.861 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2022-03-18T06:47:05.862 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T06:47:05.882 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2022-03-18T06:47:05.882 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T06:47:05.900 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2022-03-18T06:47:05.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2022-03-18T06:47:06.098 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2022-03-18T06:47:06.157 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2022-03-18T06:47:06.158 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8"
2022-03-18T06:47:06.158 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2022-03-18T06:47:06.158 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2022-03-18T06:47:06.159 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8"
2022-03-18T06:47:06.159 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2022-03-18T06:47:06.159 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T06:47:06.160 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2022-03-18T06:47:06.160 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T06:47:06.160 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2022-03-18T06:47:06.160 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T06:47:06.160 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T06:47:06.161 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T06:47:06.162 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2022-03-18T06:47:06.181 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2022-03-18T06:47:06.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2022-03-18T06:47:06.413 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2022-03-18T06:47:06.470 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2022-03-18T06:47:06.470 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2022-03-18T06:47:06.471 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2022-03-18T06:47:06.471 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2022-03-18T06:47:06.471 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2022-03-18T06:47:06.471 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2022-03-18T06:47:06.472 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T06:47:06.472 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2022-03-18T06:47:06.472 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T06:47:06.472 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2022-03-18T06:47:06.473 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T06:47:06.473 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T06:47:06.473 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T06:47:06.474 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2022-03-18T06:47:06.571 INFO:teuthology.dispatcher.supervisor:Running job 6743940
2022-03-18T06:47:06.571 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743940 --name adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743940/orig.config.yaml
2022-03-18T06:47:06.575 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743940
2022-03-18T06:47:06.576 INFO:teuthology.dispatcher.supervisor:Job PID: 2668
2022-03-18T06:47:06.576 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-18T13:17:35.391 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-18T13:17:35.575 INFO:teuthology.kill:Killing Pids: {2668}
2022-03-18T13:17:36.711 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-03-18T13:17:36.711 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-03-18T13:17:36.712 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:17:36.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2022-03-18T13:17:36.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2022-03-18T13:17:37.196 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:17:37.503 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:17:50.412 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-18T13:17:51.297 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-18T13:17:54.015 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi159.suwrqa.log: file size changed while zipping
2022-03-18T13:18:07.529 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi067.owfmgz.log: file size changed while zipping
2022-03-18T13:18:08.438 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-18T13:18:19.513 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-18T13:18:22.257 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mgr.smithi067.rmreig.log: file size changed while zipping
2022-03-18T13:18:33.957 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mon.smithi067.log: file size changed while zipping
2022-03-18T13:18:50.798 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi159.hpaubk.log: file size changed while zipping
2022-03-18T13:18:54.779 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mon.smithi159.log: file size changed while zipping
2022-03-18T13:19:05.550 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-18T13:20:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi067.tgerye.log: file size changed while zipping
2022-03-18T13:20:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/dbc7bae8-a688-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-18T13:21:08.109 INFO:teuthology.kill:No teuthology processes running
2022-03-18T13:21:09.209 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi159']
2022-03-18T13:21:10.145 INFO:teuthology.kill:2022-03-18 13:21:10,145.145 INFO:teuthology.nuke:targets:
2022-03-18T13:21:10.146 INFO:teuthology.kill:  smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcfLYYUBsWAW0YcTDsJzZmAoJLQxES9MKYYcWwgLNgyaJ5th5Bf8JjftlN30+yIIIpcrZnL/uxNNR8MGIByuKigT8DSGnEmUBoqNiTPbDiiKnu5WPOHnvzZqY7b2M1XLwSHnsITzkVMmvDS2HI9I/bQi7PZp0EPBjPPeS79NDJRhTVFRgM1/R/8Lde4N/v+zvyPHk6jyadVbonHy5gHJcJQjnxXuitaTtsYo5juzh8Pv8Cb3YMUUaHbub+wccOSPmBNOj8ZpgM4EPda9ZL/1evS0QulZQ2UuFeuUiDSVxubjaQrWtp2fAe1VejcbwGh1oRsKh9+o5vfvMz17Fq1piZ/yVN45XHnviNQQQ+Z+qkmDtIve9GTC0OohKUNtayB2jixh2O52r+guanhtu+mNHYiyB+5ru0uBto4p4Ai3y9zPzlI7YrAlJ0CW23iuJGiv2z13AlzctBTNkH2iWwxHr/mcFT2HW4FLeCsbShFRKUKwxhohU+LN0GRrwNno/bac=
2022-03-18T13:21:10.146 INFO:teuthology.kill:  smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3q5+H0yY48cY7dwGNYVVWTr6Q3ojskld4g32dxqTO3/7FIvSW2shkM0HfcX4vU2QM1BomWBK/5HrTFmxKXYIOng+JyuedCYkwZWX/B88oO/0nSvwPXP3YHX8k/cOqYqwIpE2ZIfunBfrPBC9oFuiAOZ/V3ziPeXsHF3pMd5q4Wvz+o4p2Kz3vphOM837bdq7PrZ0BKJZESCAKOG6KDuZb+2CULdPWhWgGhMxR/wJGwpirEKd8kMTdKxbbkCnd8sGKoSuMbnJ7ZKQx3dhLRvCmS4/3VLdtIRMazqACe5tw+X/2hL8zOsR0blk7fkFt1fYT+Pa78WE+gropDiO2mSDWo4UHJ9fnAgzAbqxmgtDqy+xfVxD7mHzTNb2KHdlA0B/JZT/GjBYLduaio2ihbxI2Qpv4mtKi0f8xpnsDZ/vNB9k6RtEe+RFfNPNTTJMx2VMN6f/1EAh/5dhwosx2ja1rBINkf+GtSF4Nfy5yW7PxgQRe6btxeCYjlzfgL6IXqVk=
2022-03-18T13:21:10.171 INFO:teuthology.kill:2022-03-18 13:21:10,171.171 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T13:21:10.174 INFO:teuthology.kill:2022-03-18 13:21:10,173.173 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T13:21:10.245 INFO:teuthology.kill:2022-03-18 13:21:10,244.244 INFO:teuthology.orchestra.console:Power off smithi067
2022-03-18T13:21:10.256 INFO:teuthology.kill:2022-03-18 13:21:10,256.256 INFO:teuthology.orchestra.console:Power off smithi159
2022-03-18T13:21:18.612 INFO:teuthology.kill:2022-03-18 13:21:18,611.611 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2022-03-18T13:21:18.758 INFO:teuthology.kill:2022-03-18 13:21:18,757.757 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2022-03-18T13:21:22.728 INFO:teuthology.kill:2022-03-18 13:21:22,727.727 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2022-03-18T13:21:22.873 INFO:teuthology.kill:2022-03-18 13:21:22,873.873 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com
2022-03-18T13:23:23.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-18T13:23:23.273 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi067 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-03-18_13:09:47-orch:cephadm-wip-guits-testing-2022-03-17-1934-distro-default-smithi/6745082
2022-03-18T13:23:23.273 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi159 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-03-18_13:09:47-orch:cephadm-wip-guits-testing-2022-03-17-1934-distro-default-smithi/6745082