2021-11-09T00:57:51.241 INFO:root:teuthology version: 1.1.0-27954452
2021-11-09T00:57:51.370 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging
2021-11-09T00:57:51.371 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server
2021-11-09T00:57:51.371 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2021-11-09T00:57:51.393 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete
2021-11-09T00:57:51.394 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi158.front.sepia.ceph.com' reimaging
2021-11-09T00:57:51.394 INFO:teuthology.lock.ops:Updating [ubuntu@smithi158.front.sepia.ceph.com]: reset os type and version on server
2021-11-09T00:57:51.394 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2021-11-09T00:57:51.415 INFO:teuthology.lock.ops:Node 'ubuntu@smithi158.front.sepia.ceph.com' reimaging is complete
2021-11-09T00:57:51.615 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.3
2021-11-09T00:57:51.636 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.3
2021-11-09T00:57:51.989 INFO:teuthology.orchestra.console:Power off smithi050
2021-11-09T00:57:52.004 INFO:teuthology.orchestra.console:Power off smithi158
2021-11-09T00:57:52.134 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2021-11-09T00:57:52.145 INFO:teuthology.orchestra.console:Power off for smithi158 completed
2021-11-09T00:57:52.235 INFO:teuthology.orchestra.console:Power on smithi050
2021-11-09T00:57:52.246 INFO:teuthology.orchestra.console:Power on smithi158
2021-11-09T00:58:00.597 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2021-11-09T00:58:00.601 INFO:teuthology.orchestra.console:Power on for smithi158 completed
2021-11-09T00:58:00.699 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2021-11-09T00:58:00.702 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish
2021-11-09T01:02:35.134 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-09T01:02:35.482 INFO:teuthology.provision.fog.smithi050:Node is ready
2021-11-09T01:02:35.498 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2021-11-09T01:02:35.554 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2021-11-09T01:02:35.871 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2021-11-09T01:05:18.196 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-09T01:05:18.457 INFO:teuthology.provision.fog.smithi158:Node is ready
2021-11-09T01:05:18.472 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com
2021-11-09T01:05:18.530 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158
2021-11-09T01:05:18.855 INFO:teuthology.provision.fog.smithi158:Deploy complete!
2021-11-09T01:05:18.998 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2021-11-09T01:05:18.999 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-09T01:05:19.017 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com
2021-11-09T01:05:19.018 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-09T01:05:19.035 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2021-11-09T01:05:19.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2021-11-09T01:05:19.309 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2021-11-09T01:05:19.364 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Linux"
2021-11-09T01:05:19.365 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2021-11-09T01:05:19.365 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2021-11-09T01:05:19.365 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2021-11-09T01:05:19.365 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2021-11-09T01:05:19.365 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2021-11-09T01:05:19.366 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-09T01:05:19.366 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2021-11-09T01:05:19.366 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-09T01:05:19.366 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2021-11-09T01:05:19.367 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-09T01:05:19.367 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-09T01:05:19.367 INFO:teuthology.orchestra.run.smithi050.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-09T01:05:19.368 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2021-11-09T01:05:19.412 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server
2021-11-09T01:05:19.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com'
2021-11-09T01:05:19.666 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64
2021-11-09T01:05:19.720 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Linux"
2021-11-09T01:05:19.721 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8"
2021-11-09T01:05:19.721 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos"
2021-11-09T01:05:19.721 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora"
2021-11-09T01:05:19.721 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8"
2021-11-09T01:05:19.721 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8"
2021-11-09T01:05:19.722 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-09T01:05:19.722 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2021-11-09T01:05:19.722 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-09T01:05:19.722 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/"
2021-11-09T01:05:19.723 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-09T01:05:19.723 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-09T01:05:19.723 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-09T01:05:19.724 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2021-11-09T01:05:19.813 INFO:teuthology.dispatcher.supervisor:Running job 6492815
2021-11-09T01:05:19.814 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-11-08_23:48:28-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492815 --name ozeneva-2021-11-08_23:48:28-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/ozeneva-2021-11-08_23:48:28-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492815/orig.config.yaml
2021-11-09T01:05:19.817 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-11-08_23:48:28-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492815
2021-11-09T01:05:19.817 INFO:teuthology.dispatcher.supervisor:Job PID: 16979
2021-11-09T01:05:19.818 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-09T13:06:14.027 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-09T13:06:14.188 INFO:teuthology.kill:Killing Pids: {16979}
2021-11-09T13:06:15.372 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-09T13:06:15.373 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-09T13:06:15.373 INFO:teuthology.misc:Compressing logs...
2021-11-09T13:06:15.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2021-11-09T13:06:15.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com'
2021-11-09T13:06:15.879 INFO:teuthology.misc:Compressing logs...
2021-11-09T13:06:16.224 INFO:teuthology.misc:Compressing logs...
2021-11-09T13:06:31.611 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-09T13:06:41.307 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mon.smithi050.log: file size changed while zipping
2021-11-09T13:06:50.407 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-09T13:06:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-09T13:07:04.262 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-09T13:07:26.441 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi050.jecluv.log: file size changed while zipping
2021-11-09T13:07:34.541 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi158.qgnibw.log: file size changed while zipping
2021-11-09T13:07:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi050.cccpmj.log: file size changed while zipping
2021-11-09T13:07:41.774 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mon.smithi158.log: file size changed while zipping
2021-11-09T13:07:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-09T13:08:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-mgr.smithi050.nuktey.log: file size changed while zipping
2021-11-09T13:08:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/e8e1df2c-40fa-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-09T13:09:09.204 INFO:teuthology.kill:No teuthology processes running
2021-11-09T13:09:10.352 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi158']
2021-11-09T13:09:11.344 INFO:teuthology.kill:2021-11-09 13:09:11,343.343 INFO:teuthology.nuke:targets:
2021-11-09T13:09:11.345 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0w8rYc3coqhEJBKxp97Piuc2T1wJqYaEsEVCkdQgirsTGF9xgsclW6iiyz74QUcviVdNZBiBe6Mn+BUJYOBFCi7nY7uou0JmLovZhDzsNfNIAXcAlDGsR/OhQHvhBYA3uhGqwjZmuP0TG9brtouzUWB6+8OB55OyAiO3RuiXIhQoaquNiPhPPfYJnxpjnxry5v58qBrJUca+OBg5CnmKUjcur6e8jKTflRR8xl3pLamrq9l1WREnrGPgNv41QqiqMy+zhvaXIK7aPYq/InjyCBrEdL1AS8E9JaezUrZaGEPYphrNTUh3Zu8vfgO+BW44SbLPf1VQLATQj1L4MP0c3IsT42MPCV2AqlUti0QQH+PL7KSQmpIbT6uTb7Es0Ca529lN5l1d1M5bssjbHAlIQ2yTun6K6nZ05l/KF2r0N4ljnaB8BH2hHBFh/s5jxavNWCuSAIjHYEn4ThpAeDpPpLenZlAfGJ1MSw2osO7R+0+syZrKUpHX7oSkDWxWDKl8=
2021-11-09T13:09:11.345 INFO:teuthology.kill:  smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIzAMNevITP9jIezXQkk/QnFwyZpDCF1UTaDi47gQEQCnMA+MaUu3/qQqaYbeOufpM26yIOC7Hd+JPdSv/rJ3uMIxs1qKc99clm62Dig7zTuY8boVhv/aJ9n3JTO1+nFU0Rk5DA7x++eg59mU8OlwdnxL41RhdC0qm0QvY0JVtjA7DDGDVsQugl2gKu4ouOGzCvJCnhv16HncdX7V/6kjRYKK+/iLIw/1G+PutFT6TrdNUSQE4B0kScphpJejTB11ZvhQnotxQ+1ZErc/tJhB8WVUd+pjNLcT5E9bj63UnpNEGhfdDSTzkxLu4WoesN8Pg3JhpJwaQWFWbDPy6zAAcwcAgCRo2R30ncAsAssjo5tEWGBQ9ysFE6YGs4trG7Dwl+Pj4bfKwxiSlPBf278VcGBbvoIhZg48a7Oy4Hqz46hDxLvmcz3Z1Hs0dsSTPN7aKJPC1BNRR7+TUORe9tUk0T7mUbxF8g8pJbFQ9qAT0qwm81k8CNrO6wuYnBYM8I0=
2021-11-09T13:09:11.375 INFO:teuthology.kill:2021-11-09 13:09:11,374.374 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T13:09:11.383 INFO:teuthology.kill:2021-11-09 13:09:11,383.383 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T13:09:11.448 INFO:teuthology.kill:2021-11-09 13:09:11,447.447 INFO:teuthology.orchestra.console:Power off smithi158
2021-11-09T13:09:11.461 INFO:teuthology.kill:2021-11-09 13:09:11,461.461 INFO:teuthology.orchestra.console:Power off smithi050
2021-11-09T13:09:19.830 INFO:teuthology.kill:2021-11-09 13:09:19,829.829 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2021-11-09T13:09:19.835 INFO:teuthology.kill:2021-11-09 13:09:19,835.835 INFO:teuthology.orchestra.console:Power off for smithi158 completed
2021-11-09T13:09:19.978 INFO:teuthology.kill:2021-11-09 13:09:19,977.977 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2021-11-09T13:09:19.982 INFO:teuthology.kill:2021-11-09 13:09:19,981.981 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com
2021-11-09T13:11:20.302 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-09T13:11:20.420 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-08_20:18:21-rados-wip-yuri3-testing-2021-11-08-0955-pacific-distro-basic-smithi/6492061
2021-11-09T13:11:20.420 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi158 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-08_20:18:21-rados-wip-yuri3-testing-2021-11-08-0955-pacific-distro-basic-smithi/6492061