2021-10-28T20:10:14.501 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-28T20:10:14.623 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging
2021-10-28T20:10:14.624 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server
2021-10-28T20:10:14.624 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-10-28T20:10:14.680 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete
2021-10-28T20:10:14.681 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging
2021-10-28T20:10:14.681 INFO:teuthology.lock.ops:Updating [ubuntu@smithi064.front.sepia.ceph.com]: reset os type and version on server
2021-10-28T20:10:14.681 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-10-28T20:10:14.699 INFO:teuthology.lock.ops:Node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging is complete
2021-10-28T20:10:14.884 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.3
2021-10-28T20:10:14.902 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.3
2021-10-28T20:10:15.197 INFO:teuthology.orchestra.console:Power off smithi049
2021-10-28T20:10:15.233 INFO:teuthology.orchestra.console:Power off smithi064
2021-10-28T20:10:23.565 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-10-28T20:10:23.666 INFO:teuthology.orchestra.console:Power on smithi049
2021-10-28T20:10:27.714 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-10-28T20:10:27.816 INFO:teuthology.orchestra.console:Power on smithi064
2021-10-28T20:10:32.025 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2021-10-28T20:10:32.067 INFO:teuthology.orchestra.console:Power on for smithi064 completed
2021-10-28T20:10:32.128 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2021-10-28T20:10:32.168 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2021-10-28T20:14:43.585 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-28T20:14:53.850 INFO:teuthology.provision.fog.smithi049:Node is ready
2021-10-28T20:14:53.867 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2021-10-28T20:14:53.923 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2021-10-28T20:14:54.257 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2021-10-28T20:17:25.390 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-28T20:17:25.714 INFO:teuthology.provision.fog.smithi064:Node is ready
2021-10-28T20:17:25.730 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2021-10-28T20:17:25.786 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2021-10-28T20:17:26.135 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2021-10-28T20:17:26.289 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2021-10-28T20:17:26.290 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-28T20:17:26.309 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2021-10-28T20:17:26.309 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-28T20:17:26.328 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2021-10-28T20:17:26.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2021-10-28T20:17:26.543 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2021-10-28T20:17:26.599 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Linux"
2021-10-28T20:17:26.600 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2021-10-28T20:17:26.600 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2021-10-28T20:17:26.600 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2021-10-28T20:17:26.600 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2021-10-28T20:17:26.600 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2021-10-28T20:17:26.601 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-28T20:17:26.601 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2021-10-28T20:17:26.601 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-28T20:17:26.601 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2021-10-28T20:17:26.602 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-28T20:17:26.602 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-28T20:17:26.602 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-28T20:17:26.604 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-10-28T20:17:26.621 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2021-10-28T20:17:26.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2021-10-28T20:17:26.883 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2021-10-28T20:17:26.938 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Linux"
2021-10-28T20:17:26.938 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2021-10-28T20:17:26.938 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2021-10-28T20:17:26.939 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2021-10-28T20:17:26.939 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2021-10-28T20:17:26.939 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2021-10-28T20:17:26.940 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-28T20:17:26.940 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2021-10-28T20:17:26.940 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-28T20:17:26.940 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2021-10-28T20:17:26.941 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-28T20:17:26.941 INFO:teuthology.orchestra.run.smithi064.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-28T20:17:26.941 INFO:teuthology.orchestra.run.smithi064.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-28T20:17:26.942 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-10-28T20:17:27.047 INFO:teuthology.dispatcher.supervisor:Running job 6465273
2021-10-28T20:17:27.047 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2021-10-28_20:09:21-rados:cephadm-wip-adk-testing-2021-10-28-1305-distro-basic-smithi/6465273 --name adking-2021-10-28_20:09:21-rados:cephadm-wip-adk-testing-2021-10-28-1305-distro-basic-smithi --description rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/adking-2021-10-28_20:09:21-rados:cephadm-wip-adk-testing-2021-10-28-1305-distro-basic-smithi/6465273/orig.config.yaml
2021-10-28T20:17:27.050 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2021-10-28_20:09:21-rados:cephadm-wip-adk-testing-2021-10-28-1305-distro-basic-smithi/6465273
2021-10-28T20:17:27.051 INFO:teuthology.dispatcher.supervisor:Job PID: 10975
2021-10-28T20:17:27.051 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-10-29T08:18:21.175 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-10-29T08:18:21.390 INFO:teuthology.kill:Killing Pids: {10975}
2021-10-29T08:18:22.535 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-10-29T08:18:22.536 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-10-29T08:18:22.537 INFO:teuthology.misc:Compressing logs...
2021-10-29T08:18:22.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2021-10-29T08:18:22.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2021-10-29T08:18:23.059 INFO:teuthology.misc:Compressing logs...
2021-10-29T08:18:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-29T08:18:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-29T08:18:23.807 INFO:teuthology.misc:Compressing logs...
2021-10-29T08:18:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi049.vwwhok.log: file size changed while zipping
2021-10-29T08:18:30.820 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-10-29T08:18:37.684 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-mon.smithi049.log: file size changed while zipping
2021-10-29T08:18:38.198 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-10-29T08:18:43.560 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-10-29T08:18:44.585 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-10-29T08:18:47.408 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-mon.smithi064.log: file size changed while zipping
2021-10-29T08:18:50.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-10-29T08:18:53.897 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/30b43e2e-382e-11ec-8c28-001a4aab830c/ceph-mgr.smithi049.xpswlz.log: file size changed while zipping
2021-10-29T08:19:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:tar: .: file changed as we read it
2021-10-29T08:19:49.762 INFO:teuthology.kill:No teuthology processes running
2021-10-29T08:19:50.878 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi064']
2021-10-29T08:19:51.951 INFO:teuthology.kill:2021-10-29 08:19:51,951.951 INFO:teuthology.nuke:targets:
2021-10-29T08:19:51.952 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNK3Q9dXx4cQP13oPGC5AisjyQxUul49z8VWFGHfbFOXsSdZ0XSzRgBrlM8cLutUoMI6B9Vis7PafieU9Ll+zgyijygnIcdU2hbDcYZZojtZS3Vhc6rnBLB/sU3m4EclDpoA9buUNaQHXDiw6JMmlKpFB6TlI1/IZt1HnyvSZZa0/M+nT053WM7ndgNSiFAxosOYWA3rc1ht6kHj46lEXpXHvNrH9dws6OnAHpGMfpZsuCq+7TvppZPkGbrlQfAI3g8JrtNlsYAChu7Xb7KtBKm17Jt9hTPVj7ZQeZMG3P+XPjb4pZoqSmgGagrKzeb4pvvcv0fvG0Y0lHjtvVCCScUW0DivXJkGx0hvkXUCchPWwdrNo4zqflX/wDIhPNv/hM50TbHArRJpbap3a2rtAM2CAEoWfoLJLcKfbkaTyMgWK6QgtBSMtuSargHQlO6/Np1FhyWBInnVV5Y+g4cI5Zs1bejRlvs3mqV50FVw6Zm+W+9VNSGnQkwoduKVl+Zp0=
2021-10-29T08:19:51.953 INFO:teuthology.kill:  smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8B1lnIZi8PLfCHr+YpEoKnm4/7+HT971GmTM/rq7qJM9PR8x6QDh8cMNqLdfXPtxcvPVGpsHmfB1IfInjGrR2eqOGsJYMnhTfv6sTwTJb1Rti23DpYRYk1p3ktYklXHm65RiTjBt2jsyfdJ+yqw7dqOCnv98oI9RczOsAjs9mv80WdWSHUM9AMmowGwELXfDAfDpvnaG5gaOoxSZWom7pJ+nGIZX/swPegawWn5Mx/EctCsNYTK5fX64vp89zbmREOR+q+EnRajoJnzEMcM03X/BoLKRFvdTXxzRuXYF5jq5PnjCsifX8BsEXhGAKcqj2MPJk59TugkYZ9UnlWarsL2nzIwVv20HNddNIqbWKYIbeMq2J+mgPiPLo4EKMFZiyg15yKWdkuQDSf6AuVmGqT9v3AC9ZuhvX4t2TfFH1XmzWJWuTIEVTrBERAwquKzNP2PkaDyuqiW3e7RCiJxWOwfNpwtc0B0E7z7tsup1K53UxJnsh4C5E347DxGq2H+8=
2021-10-29T08:19:51.983 INFO:teuthology.kill:2021-10-29 08:19:51,983.983 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-29T08:19:51.989 INFO:teuthology.kill:2021-10-29 08:19:51,988.988 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-29T08:19:52.077 INFO:teuthology.kill:2021-10-29 08:19:52,077.077 INFO:teuthology.orchestra.console:Power off smithi049
2021-10-29T08:19:52.090 INFO:teuthology.kill:2021-10-29 08:19:52,090.090 INFO:teuthology.orchestra.console:Power off smithi064
2021-10-29T08:20:00.641 INFO:teuthology.kill:2021-10-29 08:20:00,640.640 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-10-29T08:20:00.786 INFO:teuthology.kill:2021-10-29 08:20:00,785.785 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com
2021-10-29T08:20:04.601 INFO:teuthology.kill:2021-10-29 08:20:04,601.601 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-10-29T08:20:04.754 INFO:teuthology.kill:2021-10-29 08:20:04,754.754 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2021-10-29T08:22:05.034 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-10-29T08:22:05.168 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6465993
2021-10-29T08:22:05.168 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6465993