2021-11-01T22:40:14.737 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-01T22:40:14.875 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging
2021-11-01T22:40:14.876 INFO:teuthology.lock.ops:Updating [ubuntu@smithi074.front.sepia.ceph.com]: reset os type and version on server
2021-11-01T22:40:14.877 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2021-11-01T22:40:14.896 INFO:teuthology.lock.ops:Node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging is complete
2021-11-01T22:40:14.897 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging
2021-11-01T22:40:14.898 INFO:teuthology.lock.ops:Updating [ubuntu@smithi101.front.sepia.ceph.com]: reset os type and version on server
2021-11-01T22:40:14.898 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2021-11-01T22:40:14.921 INFO:teuthology.lock.ops:Node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging is complete
2021-11-01T22:40:15.114 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.3
2021-11-01T22:40:15.133 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.3
2021-11-01T22:40:15.450 INFO:teuthology.orchestra.console:Power off smithi074
2021-11-01T22:40:15.489 INFO:teuthology.orchestra.console:Power off smithi101
2021-11-01T22:40:23.825 INFO:teuthology.orchestra.console:Power off for smithi074 completed
2021-11-01T22:40:23.926 INFO:teuthology.orchestra.console:Power on smithi074
2021-11-01T22:40:27.978 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2021-11-01T22:40:28.079 INFO:teuthology.orchestra.console:Power on smithi101
2021-11-01T22:40:32.329 INFO:teuthology.orchestra.console:Power on for smithi074 completed
2021-11-01T22:40:32.333 INFO:teuthology.orchestra.console:Power on for smithi101 completed
2021-11-01T22:40:32.430 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish
2021-11-01T22:40:32.434 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish
2021-11-01T22:45:22.594 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-01T22:45:22.880 INFO:teuthology.provision.fog.smithi074:Node is ready
2021-11-01T22:45:22.896 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com
2021-11-01T22:45:22.950 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074
2021-11-01T22:45:23.271 INFO:teuthology.provision.fog.smithi074:Deploy complete!
2021-11-01T22:45:37.506 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-01T22:45:37.796 INFO:teuthology.provision.fog.smithi101:Node is ready
2021-11-01T22:45:37.811 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com
2021-11-01T22:45:37.867 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101
2021-11-01T22:45:38.197 INFO:teuthology.provision.fog.smithi101:Deploy complete!
2021-11-01T22:45:38.360 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com
2021-11-01T22:45:38.361 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-01T22:45:38.381 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com
2021-11-01T22:45:38.381 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-01T22:45:38.401 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server
2021-11-01T22:45:38.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com'
2021-11-01T22:45:38.671 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64
2021-11-01T22:45:38.726 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Linux"
2021-11-01T22:45:38.727 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8"
2021-11-01T22:45:38.727 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos"
2021-11-01T22:45:38.727 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora"
2021-11-01T22:45:38.727 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8"
2021-11-01T22:45:38.728 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8"
2021-11-01T22:45:38.728 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-01T22:45:38.728 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31"
2021-11-01T22:45:38.728 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-01T22:45:38.729 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/"
2021-11-01T22:45:38.729 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-01T22:45:38.729 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-01T22:45:38.729 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-01T22:45:38.731 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2021-11-01T22:45:38.751 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server
2021-11-01T22:45:38.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2021-11-01T22:45:38.960 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64
2021-11-01T22:45:39.016 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Linux"
2021-11-01T22:45:39.016 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8"
2021-11-01T22:45:39.017 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos"
2021-11-01T22:45:39.017 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora"
2021-11-01T22:45:39.018 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8"
2021-11-01T22:45:39.018 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8"
2021-11-01T22:45:39.018 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-01T22:45:39.018 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31"
2021-11-01T22:45:39.019 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-01T22:45:39.020 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/"
2021-11-01T22:45:39.020 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-01T22:45:39.021 INFO:teuthology.orchestra.run.smithi101.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-01T22:45:39.021 INFO:teuthology.orchestra.run.smithi101.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-01T22:45:39.022 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2021-11-01T22:45:39.128 INFO:teuthology.dispatcher.supervisor:Running job 6473981
2021-11-01T22:45:39.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-11-01_22:19:29-orch:cephadm-wip-sage2-testing-2021-11-01-1529-distro-basic-smithi/6473981 --name sage-2021-11-01_22:19:29-orch:cephadm-wip-sage2-testing-2021-11-01-1529-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/sage-2021-11-01_22:19:29-orch:cephadm-wip-sage2-testing-2021-11-01-1529-distro-basic-smithi/6473981/orig.config.yaml
2021-11-01T22:45:39.132 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-11-01_22:19:29-orch:cephadm-wip-sage2-testing-2021-11-01-1529-distro-basic-smithi/6473981
2021-11-01T22:45:39.133 INFO:teuthology.dispatcher.supervisor:Job PID: 32625
2021-11-01T22:45:39.133 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-02T10:46:34.123 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-02T10:46:34.309 INFO:teuthology.kill:Killing Pids: {32625}
2021-11-02T10:46:35.473 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-02T10:46:35.473 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-02T10:46:35.474 INFO:teuthology.misc:Compressing logs...
2021-11-02T10:46:35.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com'
2021-11-02T10:46:35.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2021-11-02T10:46:35.984 INFO:teuthology.misc:Compressing logs...
2021-11-02T10:46:36.306 INFO:teuthology.misc:Compressing logs...
2021-11-02T10:46:39.654 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi074.ukofvc.log: file size changed while zipping
2021-11-02T10:46:50.524 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mgr.smithi074.tmjoav.log: file size changed while zipping
2021-11-02T10:46:52.823 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-02T10:47:12.455 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-02T10:47:13.358 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mon.smithi074.log: file size changed while zipping
2021-11-02T10:47:29.647 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-02T10:47:59.091 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi101.vonlxn.log: file size changed while zipping
2021-11-02T10:48:05.998 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mon.smithi101.log: file size changed while zipping
2021-11-02T10:48:06.577 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi074.ketnlx.log: file size changed while zipping
2021-11-02T10:48:20.505 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-02T10:48:21.079 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-02T10:48:38.552 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/27000606-3b67-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-02T10:49:24.801 INFO:teuthology.orchestra.run.smithi101.stderr:tar: .: file changed as we read it
2021-11-02T10:49:24.884 INFO:teuthology.kill:No teuthology processes running
2021-11-02T10:49:26.009 INFO:teuthology.kill:Nuking machines: ['smithi074', 'smithi101']
2021-11-02T10:49:27.000 INFO:teuthology.kill:2021-11-02 10:49:27,000.000 INFO:teuthology.nuke:targets:
2021-11-02T10:49:27.001 INFO:teuthology.kill:  smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCqXnX3CexiUJ8z00CkeaicQnzAIdhNOWM+B/z4/TvgcD8X7atx2oNPMpyV/tkaXBG+RyLpxQnfx05edi67b0PRUdErIDKM++3egQyB5vKBYJxi0KZDmRwSjKV2rBnfouCf5PP1RlA5p2Eg6GsGKDqcJvVrXJIE77A2Cn4Z7Qo0dxAjf+giRNSaAabz/GD+qQaXHDBm7YSAfyyfxs1SBqpEywCGT+idaVyLS+raF61/o92ySFlsSyqTBviTyPHEBAMekGKgYFMSXPVM6C9CeJrCMWwyNydQX+jiM0X70cUpUuMTfYcwlGj8WLuaoIbu9JL4+A8P4UZUbkrHkqXrYLU1hESsiAEHHpiLbIuE1JKakcPglRhoT84UaXeU7DvwMYeNTjxxXW+DKEVN4SpYAZIKJQD8shO8jGmpGvRxEnc4S7dRplid89/g+sABa1ramB3VxleJqyzHG7E1Dfji2pcTzrDbD2G5jekdvxOB1e7yunqQF3XVFXxtkwsb3q+czM=
2021-11-02T10:49:27.002 INFO:teuthology.kill:  smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDExl7P1vuc39Lxuem49s2LlrAz+beJgscVAWulTqTcI3cUeqz3VZoX7OxMNHuF+DUMAAlBDuvrNCW0nKpdg/SC8iBZ4uP4xa5IhiCLZjNOg82dhEU3szxOoqPYDIYkySrpTqOKb4niKpfm3SFYx1Uy60lza7b82KfXLL87uEMom9ufSWI84kCNEqUPI1eZk6w4uwSfJI68dYMPdW36GgohO77/BOHK2Magf62OejCpfO6z3JmlQHOIJA6VW6ghGq73UYGKIG87NAzLIwcgSmb46wy3XEBgzhbvLSHoQIBr3jEKmC7Cb36H7yXQU8m5kdSkMhoLtO/lguf2CM+6h8uioBmdMb4QdVAZBVTqW91rLFA2dgQH9WmFrQcWsYm+HVbYHpUeinPia0F+uUWSeuADelBZhEilmTRprdx5VU54d9aw8Ve0rSCY4Itl+j4mqL8Azk+S8J7v6bwnM4SE4jqlHknrd6CTkPse1IkVZkU6Uo42un2lcXuzxO/TUn6Gzss=
2021-11-02T10:49:27.027 INFO:teuthology.kill:2021-11-02 10:49:27,027.027 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-02T10:49:27.031 INFO:teuthology.kill:2021-11-02 10:49:27,031.031 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-02T10:49:27.106 INFO:teuthology.kill:2021-11-02 10:49:27,106.106 INFO:teuthology.orchestra.console:Power off smithi074
2021-11-02T10:49:27.120 INFO:teuthology.kill:2021-11-02 10:49:27,120.120 INFO:teuthology.orchestra.console:Power off smithi101
2021-11-02T10:49:35.472 INFO:teuthology.kill:2021-11-02 10:49:35,472.472 INFO:teuthology.orchestra.console:Power off for smithi074 completed
2021-11-02T10:49:35.480 INFO:teuthology.kill:2021-11-02 10:49:35,480.480 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2021-11-02T10:49:35.624 INFO:teuthology.kill:2021-11-02 10:49:35,623.623 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com
2021-11-02T10:49:35.628 INFO:teuthology.kill:2021-11-02 10:49:35,627.627 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com
2021-11-02T10:51:35.930 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-02T10:51:36.042 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-02_10:26:57-rgw-wip-omri-tracer-opentelemetry-distro-basic-smithi/6475223
2021-11-02T10:51:36.042 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-02_10:26:57-rgw-wip-omri-tracer-opentelemetry-distro-basic-smithi/6475223