2021-11-05T23:49:51.954 INFO:root:teuthology version: 1.1.0-27954452
2021-11-05T23:49:52.112 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi040.front.sepia.ceph.com' reimaging
2021-11-05T23:49:52.113 INFO:teuthology.lock.ops:Updating [ubuntu@smithi040.front.sepia.ceph.com]: reset os type and version on server
2021-11-05T23:49:52.114 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2021-11-05T23:49:52.131 INFO:teuthology.lock.ops:Node 'ubuntu@smithi040.front.sepia.ceph.com' reimaging is complete
2021-11-05T23:49:52.132 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging
2021-11-05T23:49:52.132 INFO:teuthology.lock.ops:Updating [ubuntu@smithi118.front.sepia.ceph.com]: reset os type and version on server
2021-11-05T23:49:52.132 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2021-11-05T23:49:52.150 INFO:teuthology.lock.ops:Node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging is complete
2021-11-05T23:49:52.341 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.3
2021-11-05T23:49:52.347 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.3
2021-11-05T23:49:52.639 INFO:teuthology.orchestra.console:Power off smithi040
2021-11-05T23:49:52.652 INFO:teuthology.orchestra.console:Power off smithi118
2021-11-05T23:50:05.137 INFO:teuthology.orchestra.console:Power off for smithi118 completed
2021-11-05T23:50:05.142 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2021-11-05T23:50:05.239 INFO:teuthology.orchestra.console:Power on smithi118
2021-11-05T23:50:05.245 INFO:teuthology.orchestra.console:Power on smithi040
2021-11-05T23:50:09.491 INFO:teuthology.orchestra.console:Power on for smithi118 completed
2021-11-05T23:50:09.592 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2021-11-05T23:50:13.662 INFO:teuthology.orchestra.console:Power on for smithi040 completed
2021-11-05T23:50:13.763 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2021-11-05T23:53:55.377 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-05T23:54:10.756 INFO:teuthology.provision.fog.smithi040:Node is ready
2021-11-05T23:54:10.814 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2021-11-05T23:54:10.869 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2021-11-05T23:54:11.223 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2021-11-05T23:55:59.989 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-05T23:56:00.304 INFO:teuthology.provision.fog.smithi118:Node is ready
2021-11-05T23:56:00.321 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2021-11-05T23:56:00.377 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2021-11-05T23:56:00.723 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2021-11-05T23:56:00.874 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2021-11-05T23:56:00.875 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-05T23:56:00.896 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2021-11-05T23:56:00.897 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-05T23:56:00.933 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2021-11-05T23:56:00.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2021-11-05T23:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2021-11-05T23:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Linux"
2021-11-05T23:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8"
2021-11-05T23:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2021-11-05T23:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2021-11-05T23:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8"
2021-11-05T23:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8"
2021-11-05T23:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-05T23:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2021-11-05T23:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-05T23:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2021-11-05T23:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-05T23:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-05T23:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-05T23:56:01.264 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2021-11-05T23:56:01.282 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2021-11-05T23:56:01.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2021-11-05T23:56:01.493 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2021-11-05T23:56:01.549 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Linux"
2021-11-05T23:56:01.549 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2021-11-05T23:56:01.549 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2021-11-05T23:56:01.550 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2021-11-05T23:56:01.550 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2021-11-05T23:56:01.551 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2021-11-05T23:56:01.551 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-05T23:56:01.552 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2021-11-05T23:56:01.552 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-05T23:56:01.552 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2021-11-05T23:56:01.553 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-05T23:56:01.553 INFO:teuthology.orchestra.run.smithi118.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-05T23:56:01.554 INFO:teuthology.orchestra.run.smithi118.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-05T23:56:01.555 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2021-11-05T23:56:01.647 INFO:teuthology.dispatcher.supervisor:Running job 6488205
2021-11-05T23:56:01.647 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-11-05_21:58:54-orch:cephadm-wip-sage-testing-2021-11-05-1502-distro-basic-smithi/6488205 --name sage-2021-11-05_21:58:54-orch:cephadm-wip-sage-testing-2021-11-05-1502-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/sage-2021-11-05_21:58:54-orch:cephadm-wip-sage-testing-2021-11-05-1502-distro-basic-smithi/6488205/orig.config.yaml
2021-11-05T23:56:01.650 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-11-05_21:58:54-orch:cephadm-wip-sage-testing-2021-11-05-1502-distro-basic-smithi/6488205
2021-11-05T23:56:01.651 INFO:teuthology.dispatcher.supervisor:Job PID: 28045
2021-11-05T23:56:01.651 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-06T11:56:52.770 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-06T11:56:53.051 INFO:teuthology.kill:Killing Pids: {28045}
2021-11-06T11:56:54.207 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-06T11:56:54.208 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-06T11:56:54.208 INFO:teuthology.misc:Compressing logs...
2021-11-06T11:56:54.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2021-11-06T11:56:54.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2021-11-06T11:56:54.707 INFO:teuthology.misc:Compressing logs...
2021-11-06T11:56:54.990 INFO:teuthology.misc:Compressing logs...
2021-11-06T11:57:04.475 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mgr.smithi040.ovnutb.log: file size changed while zipping
2021-11-06T11:57:08.939 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-06T11:57:15.254 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mon.smithi118.log: file size changed while zipping
2021-11-06T11:57:20.023 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-06T11:57:32.595 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-06T11:57:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mon.smithi040.log: file size changed while zipping
2021-11-06T11:57:45.763 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-06T11:57:45.919 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi040.voroij.log: file size changed while zipping
2021-11-06T11:57:48.576 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi118.mmyrhm.log: file size changed while zipping
2021-11-06T11:57:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-06T11:58:16.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-06T11:58:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/a2d5ee2c-3e95-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi040.nxzdmn.log: file size changed while zipping
2021-11-06T11:59:28.353 INFO:teuthology.kill:No teuthology processes running
2021-11-06T11:59:29.584 INFO:teuthology.kill:Nuking machines: ['smithi040', 'smithi118']
2021-11-06T11:59:30.536 INFO:teuthology.kill:2021-11-06 11:59:30,536.536 INFO:teuthology.nuke:targets:
2021-11-06T11:59:30.537 INFO:teuthology.kill:  smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChhZpItZQO0e4nHDGNiuQycVF/9qzHOET4cR5ISFVbYkXC7cPa6UFhx9sQxUBDoONplmxlMKGzMvTxTvgs7qWBlyUuK6BHyGgzyUopj1Rvt3M6XFEm59rbkVw4gl5ApouTNd0vMKKuuziLeDQYynPpBa3YMX0dy275/2vy2MBTThF5lT2AjgLpJMtX0gT3YnEc1MsNbHpRgR3SSkVcRvVnz7IzSb9I9xbnzazyNDLObjwbqJWFFKJjcb0O8Puj//Z4V+ctlF/490/SbdD2P9x7dOiTWUUT0K04WiJkT35fkN89ziIx6c0YuurtmB9FIscOwzVvTjGIPDZ846yP2cw6IddxknLfLtWpIgAo8Sok7cRBzUjUjtWYceu3eX7YL+Kvd+Ul5Hk2Dh8sEGphzNTLeDeFmXjzH4+KCmDpM4GE9qKxG7JKdCyO5n7/Ez16Ds57Pn7JlqEMT2v6IK2dc11RQXTUzuzj7KIzuT6aw53noaiccXRUMclogzWwHqhacTk=
2021-11-06T11:59:30.538 INFO:teuthology.kill:  smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9bnA7KYLIf9t5oMQF+Ul0GTIqFNd8d3YzCi2vJMMN8Lla26HGrVemykttXhJdD5kFx3c1ZpM7qT/e6KJez4cxe+vwtZAKrnzrCUhNowguvgOpUvqbHgXd1ge5rYyTuVFZs/wxZx9cqavc0kM0/8aixodW9s1ZjmCLwJHF8MrvgF64hfLvg7DB//N+XurGAMXtax4naLi4YPs4Eh/qu+qVLXMneMRfj3hk/hxwo2Cc0swnrC9ZLAlLhYcJJ81Zzt3XLCBfT57ZMZIbtUQGo3N9SOcKzIQ50cESG+vv/RIinaPQxon4S/XfI95n76rL69zIk8/SM71xHb4LH5F2e6PtWZoqpPaj59hFzd/qY0vGIAbbpG3OFi6V9yao+8FpT5Hooa59tPywc7b2O3B2BzsGiQ9dsBgZRBGLanKGM4zEtnAddl31E17esgAwITZ3CefLGKR1sdKQYq4ewsTLH4pEC9qpc9QHh1Ype2G4XKbdyXWXCc7pcPGl9GdCkoXsXN0=
2021-11-06T11:59:30.563 INFO:teuthology.kill:2021-11-06 11:59:30,563.563 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-06T11:59:30.566 INFO:teuthology.kill:2021-11-06 11:59:30,566.566 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-06T11:59:30.644 INFO:teuthology.kill:2021-11-06 11:59:30,644.644 INFO:teuthology.orchestra.console:Power off smithi118
2021-11-06T11:59:30.657 INFO:teuthology.kill:2021-11-06 11:59:30,657.657 INFO:teuthology.orchestra.console:Power off smithi040
2021-11-06T11:59:39.014 INFO:teuthology.kill:2021-11-06 11:59:39,014.014 INFO:teuthology.orchestra.console:Power off for smithi118 completed
2021-11-06T11:59:39.159 INFO:teuthology.kill:2021-11-06 11:59:39,158.158 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com
2021-11-06T11:59:43.132 INFO:teuthology.kill:2021-11-06 11:59:43,131.131 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2021-11-06T11:59:43.277 INFO:teuthology.kill:2021-11-06 11:59:43,277.277 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com
2021-11-06T12:01:43.589 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-06T12:01:43.705 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi118 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-04_23:53:22-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6485947