2021-11-08T21:03:39.057 INFO:root:teuthology version: 1.1.0-27954452
2021-11-08T21:03:39.178 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging
2021-11-08T21:03:39.179 INFO:teuthology.lock.ops:Updating [ubuntu@smithi065.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T21:03:39.181 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2021-11-08T21:03:39.203 INFO:teuthology.lock.ops:Node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging is complete
2021-11-08T21:03:39.203 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging
2021-11-08T21:03:39.203 INFO:teuthology.lock.ops:Updating [ubuntu@smithi092.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T21:03:39.204 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2021-11-08T21:03:39.223 INFO:teuthology.lock.ops:Node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging is complete
2021-11-08T21:03:39.414 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of centos 8.3
2021-11-08T21:03:39.427 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.3
2021-11-08T21:03:39.738 INFO:teuthology.orchestra.console:Power off smithi065
2021-11-08T21:03:39.756 INFO:teuthology.orchestra.console:Power off smithi092
2021-11-08T21:03:39.891 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2021-11-08T21:03:39.900 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2021-11-08T21:03:39.994 INFO:teuthology.orchestra.console:Power on smithi065
2021-11-08T21:03:40.002 INFO:teuthology.orchestra.console:Power on smithi092
2021-11-08T21:03:44.254 INFO:teuthology.orchestra.console:Power on for smithi065 completed
2021-11-08T21:03:44.356 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish
2021-11-08T21:03:48.372 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2021-11-08T21:03:48.473 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2021-11-08T21:08:37.833 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T21:08:38.147 INFO:teuthology.provision.fog.smithi092:Node is ready
2021-11-08T21:08:38.164 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2021-11-08T21:08:38.221 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2021-11-08T21:08:38.542 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2021-11-08T21:08:48.898 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T21:08:49.210 INFO:teuthology.provision.fog.smithi065:Node is ready
2021-11-08T21:08:49.227 INFO:teuthology.orchestra.run.smithi065.stdout:smithi065.front.sepia.ceph.com
2021-11-08T21:08:49.284 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.65 smithi065.front.sepia.ceph.com smithi065
2021-11-08T21:08:49.637 INFO:teuthology.provision.fog.smithi065:Deploy complete!
2021-11-08T21:08:49.791 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com
2021-11-08T21:08:49.792 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T21:08:49.810 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2021-11-08T21:08:49.811 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T21:08:49.829 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server
2021-11-08T21:08:49.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2021-11-08T21:08:50.071 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64
2021-11-08T21:08:50.126 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="CentOS Linux"
2021-11-08T21:08:50.127 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8"
2021-11-08T21:08:50.127 INFO:teuthology.orchestra.run.smithi065.stdout:ID="centos"
2021-11-08T21:08:50.127 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="rhel fedora"
2021-11-08T21:08:50.127 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8"
2021-11-08T21:08:50.128 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8"
2021-11-08T21:08:50.128 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-08T21:08:50.128 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31"
2021-11-08T21:08:50.129 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-08T21:08:50.129 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://centos.org/"
2021-11-08T21:08:50.129 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-08T21:08:50.130 INFO:teuthology.orchestra.run.smithi065.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-08T21:08:50.130 INFO:teuthology.orchestra.run.smithi065.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-08T21:08:50.132 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2021-11-08T21:08:50.156 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2021-11-08T21:08:50.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2021-11-08T21:08:50.442 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2021-11-08T21:08:50.498 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Linux"
2021-11-08T21:08:50.498 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8"
2021-11-08T21:08:50.499 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2021-11-08T21:08:50.499 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2021-11-08T21:08:50.499 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2021-11-08T21:08:50.499 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2021-11-08T21:08:50.500 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-08T21:08:50.500 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2021-11-08T21:08:50.500 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-08T21:08:50.500 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2021-11-08T21:08:50.501 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-08T21:08:50.501 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-08T21:08:50.501 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-08T21:08:50.502 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2021-11-08T21:08:50.667 INFO:teuthology.dispatcher.supervisor:Running job 6492753
2021-11-08T21:08:50.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-11-08_20:31:46-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492753 --name ozeneva-2021-11-08_20:31:46-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/ozeneva-2021-11-08_20:31:46-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492753/orig.config.yaml
2021-11-08T21:08:50.671 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-11-08_20:31:46-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6492753
2021-11-08T21:08:50.672 INFO:teuthology.dispatcher.supervisor:Job PID: 12209
2021-11-08T21:08:50.673 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-09T09:09:44.337 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-09T09:09:44.469 INFO:teuthology.kill:Killing Pids: {12209}
2021-11-09T09:09:45.704 INFO:teuthology.task.internal:roles: ubuntu@smithi065.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-09T09:09:45.705 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-09T09:09:45.705 INFO:teuthology.misc:Compressing logs...
2021-11-09T09:09:45.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2021-11-09T09:09:45.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2021-11-09T09:09:46.233 INFO:teuthology.misc:Compressing logs...
2021-11-09T09:09:46.519 INFO:teuthology.misc:Compressing logs...
2021-11-09T09:09:51.081 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi065.cpspnq.log: file size changed while zipping
2021-11-09T09:10:00.663 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-09T09:10:03.694 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi092.sxbmrx.log: file size changed while zipping
2021-11-09T09:10:12.870 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mon.smithi065.log: file size changed while zipping
2021-11-09T09:10:21.378 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-09T09:10:28.884 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-09T09:10:37.976 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mgr.smithi065.tgnwiq.log: file size changed while zipping
2021-11-09T09:10:52.263 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-09T09:10:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi092.vorhqe.log: file size changed while zipping
2021-11-09T09:10:57.514 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi065.aeqmpu.log: file size changed while zipping
2021-11-09T09:11:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-09T09:11:14.486 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-09T09:11:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/db846a46-40d9-11ec-8c2c-001a4aab830c/ceph-mon.smithi092.log: file size changed while zipping
2021-11-09T09:11:50.922 INFO:teuthology.kill:No teuthology processes running
2021-11-09T09:11:52.063 INFO:teuthology.kill:Nuking machines: ['smithi065', 'smithi092']
2021-11-09T09:11:53.145 INFO:teuthology.kill:2021-11-09 09:11:53,145.145 INFO:teuthology.nuke:targets:
2021-11-09T09:11:53.146 INFO:teuthology.kill:  smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrjT68Y6YdJbHGMrYIyRFW36N/wH9V0StfJ8WE3EutyypmRFnuSxuZWpOAsNxPVqHI9nVWjFjHb5NgNcQF9sJRETW4GoBoY055h/iiXIdEZoWKcQf8s2M2R97umm56XSq+cDz980jIvCzmmmBJiigfcY3ORkfZOoSpjJNCVBLGpkEo8Ycob2fuen+mVQY1naJ+2FDBghqAMJGpgMRgabvJSTPiS+YdF4Z6Qyq2b4heKwWH1vazwEIkWlkt3gweklkmHwef6ONh6C6nsn0HqFGs/ViTXPtPrMqFaixVwfNpVrbvVDkDVXsSFI0r15IhFyqKURbn8iKbtUkFVOqlj3LQc73iwKyAX7CpeAVrChQNGVhfz1hnNSQkLhPIEKAGe9FauK5NPmSVw15bgbpUSRdPrtYHa4MkBr+InsAizFPXSQ4ArhD5Wm9VcDQl8XfOBaGBYOdMrdVmBzptIEglnhGUz/iub4k/qELW2onMB7pdQO8v275vBijwBApukJakm0s=
2021-11-09T09:11:53.147 INFO:teuthology.kill:  smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh6M7VbsBeVAvTtjDJQ52qccyyasrXoaqA8zzrmgcxyWroNm07G33VwJJCcKROSm0GyLRfGcn66Sf43N4YtSjcS1IX0355WKSRcT1Osp4EvWGYbwVT5OXK3snSzCfJ/JeAltMAmeljl5Cp8Iw3PBRHyNFeCRJI8iRlJj1d1llG9yuWn06hH4jIkJxempcxRaYVhnAYpwhl4t03Sm+7bXiZYVDTGPtztamqiNiYQbAT/6ab31leyY6VSLlYqEg7MhZFnWDIONybVPf/LeTmoppwRNvC5EiO04Gabd+BwmA3RzTM+VLnNrlF9Hb2aAcVL8wUHqgUeapbevCgoJFdNY5rX7Ybyo3KM9RJuWbCooZuJjU7s6e32VAE68joUxYuq81nLnS3HP9ObNhv2+YhTa6VFTkqrxZg5nXyDnN1qd97j0KxxWdVRidTzzQ9Jw0lHyOdYooVSOS2IgCi0gKGXnZVzZKSSjtp5N56tmNWEMW3wqGYHzKdtc8pXp67ABO5m30=
2021-11-09T09:11:53.174 INFO:teuthology.kill:2021-11-09 09:11:53,173.173 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T09:11:53.178 INFO:teuthology.kill:2021-11-09 09:11:53,178.178 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T09:11:53.255 INFO:teuthology.kill:2021-11-09 09:11:53,255.255 INFO:teuthology.orchestra.console:Power off smithi092
2021-11-09T09:11:53.272 INFO:teuthology.kill:2021-11-09 09:11:53,271.271 INFO:teuthology.orchestra.console:Power off smithi065
2021-11-09T09:12:01.634 INFO:teuthology.kill:2021-11-09 09:12:01,634.634 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2021-11-09T09:12:01.790 INFO:teuthology.kill:2021-11-09 09:12:01,789.789 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2021-11-09T09:12:05.756 INFO:teuthology.kill:2021-11-09 09:12:05,755.755 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2021-11-09T09:12:05.907 INFO:teuthology.kill:2021-11-09 09:12:05,907.907 INFO:teuthology.lock.ops:unlocked: smithi065.front.sepia.ceph.com
2021-11-09T09:14:06.223 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15