2022-09-28T22:40:59.034 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-09-28T22:40:59.209 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2022-09-28T22:40:59.210 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2022-09-28T22:40:59.210 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2022-09-28T22:40:59.230 INFO:teuthology.lock.ops:Node 'smithi043.front.sepia.ceph.com' reimaging is complete
2022-09-28T22:40:59.231 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2022-09-28T22:40:59.231 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2022-09-28T22:40:59.232 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2022-09-28T22:40:59.251 INFO:teuthology.lock.ops:Node 'smithi053.front.sepia.ceph.com' reimaging is complete
2022-09-28T22:40:59.447 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream
2022-09-28T22:40:59.459 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 8.stream
2022-09-28T22:40:59.752 INFO:teuthology.orchestra.console:Power off smithi043
2022-09-28T22:40:59.769 INFO:teuthology.orchestra.console:Power off smithi053
2022-09-28T22:40:59.896 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2022-09-28T22:40:59.909 INFO:teuthology.orchestra.console:Power off for smithi053 completed
2022-09-28T22:40:59.998 INFO:teuthology.orchestra.console:Power on smithi043
2022-09-28T22:41:00.010 INFO:teuthology.orchestra.console:Power on smithi053
2022-09-28T22:41:04.259 INFO:teuthology.orchestra.console:Power on for smithi053 completed
2022-09-28T22:41:04.360 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2022-09-28T22:41:08.364 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2022-09-28T22:41:08.465 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2022-09-28T22:44:49.586 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-28T22:45:09.733 INFO:teuthology.provision.fog.smithi053:Node is ready
2022-09-28T22:45:09.756 INFO:teuthology.orchestra.run.smithi053.stdout:smithi186
2022-09-28T22:45:09.816 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2022-09-28T22:45:10.213 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2022-09-28T22:45:22.235 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-28T22:45:22.508 INFO:teuthology.provision.fog.smithi043:Node is ready
2022-09-28T22:45:22.527 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2022-09-28T22:45:22.585 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2022-09-28T22:45:22.937 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2022-09-28T22:45:23.198 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2022-09-28T22:45:23.199 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-28T22:45:23.218 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2022-09-28T22:45:23.218 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-28T22:45:23.237 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2022-09-28T22:45:23.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2022-09-28T22:45:23.429 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2022-09-28T22:45:23.487 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2022-09-28T22:45:23.487 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2022-09-28T22:45:23.487 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2022-09-28T22:45:23.488 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2022-09-28T22:45:23.488 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2022-09-28T22:45:23.488 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2022-09-28T22:45:23.488 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-28T22:45:23.489 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2022-09-28T22:45:23.489 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-28T22:45:23.489 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2022-09-28T22:45:23.489 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-28T22:45:23.489 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-28T22:45:23.490 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-28T22:45:23.491 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2022-09-28T22:45:23.510 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2022-09-28T22:45:23.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2022-09-28T22:45:23.776 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2022-09-28T22:45:23.835 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2022-09-28T22:45:23.835 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8"
2022-09-28T22:45:23.835 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2022-09-28T22:45:23.835 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2022-09-28T22:45:23.836 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8"
2022-09-28T22:45:23.836 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2022-09-28T22:45:23.836 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-28T22:45:23.836 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2022-09-28T22:45:23.837 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-28T22:45:23.837 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2022-09-28T22:45:23.837 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-28T22:45:23.837 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-28T22:45:23.838 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-28T22:45:23.838 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2022-09-28T22:45:23.939 INFO:teuthology.dispatcher.supervisor:Running job 7046988
2022-09-28T22:45:23.939 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046988 --name lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi --description upgrade:telemetry-upgrade/pacific-x/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity} -- /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046988/orig.config.yaml
2022-09-28T22:45:23.945 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046988
2022-09-28T22:45:23.946 INFO:teuthology.dispatcher.supervisor:Job PID: 7764
2022-09-28T22:45:23.946 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-29T10:46:14.866 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-29T10:46:15.396 INFO:teuthology.kill:Killing Pids: {7764}
2022-09-29T10:46:24.831 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-09-29T10:46:24.836 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-09-29T10:46:24.840 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:24.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2022-09-29T10:46:25.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2022-09-29T10:46:26.511 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:27.257 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:37.319 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-09-29T10:46:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-09-29T10:46:48.555 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-09-29T10:46:49.945 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-09-29T10:46:52.647 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-09-29T10:47:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-09-29T10:47:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-09-29T10:47:09.240 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-09-29T10:47:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-09-29T10:47:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-09-29T10:47:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-09-29T10:47:34.119 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/37383b10-3f80-11ed-8431-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-09-29T10:48:59.337 INFO:teuthology.kill:No teuthology processes running
2022-09-29T10:49:00.824 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi053']
2022-09-29T10:49:02.283 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-29T10:49:02.285 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-29T10:49:02.285 INFO:teuthology.kill:2022-09-29 10:49:02,283.283 INFO:teuthology.nuke:targets:
2022-09-29T10:49:02.286 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCharA/zLzRHLjy1rItgTekmg+LL8eh4IAgFCmagJ/oaeDpFH9NyoO3GaB23FLCRa0pyHKqyZPrhcv/2SEKG1gLOJDJ7c20Q9Bo091QWzUmr25/jL+/N5K1UqCN3nqqeaUZGRPdXiKbgX59KkcdhFegXIFS7IM0btXkY+GurYpRhNG8YdiQW411v7LTcGP+qbOeoZ/ua20H5HEv0r5oXjH2iEp4b12/gabPy2vxRcd4hVb3jsRVWud+x5Ng/aDajBHTV1f6sQXY2qhWlM3v0aC4Nit2Linq7zgCfWHs/BqKddNISJplB5Gg55lJw3CPz1+fyqdR6g05uQyTkBA2cmyenocFaEYIJGGl8M2SjPjQahcrlSod1tEOgC/aVevkZiH0oosPO8SrhEkG8IUZ4WZqFVya+rRyPNLncgYnZsVuiwke6zxdmI7cWQzgrBZ1lCcP9RGLZawKEaXalICSEG+XM03D+Yd0pb1mq9HJJZNdcvbqUNbeltkMZxYaD2/McV0=
2022-09-29T10:49:02.287 INFO:teuthology.kill:  smithi053.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/vtsHYvSTeRMoK+FDzhhkgzv93QHKjsSOU3Nznxbyb7WD+Lx40JAOo37HLvK8NjfYMlqedZEssqmHB/XumwOXH+ALTDuEr+rV2+BjAMUmmkJ53oqmPg9bOdWBg+NIzNOEZQZ9VnGDXEc/ZyiFkC3byB1c+V+ydGoa54h8d9L2kbYe8W6AOD8dUuFOtooT3/AM6SXHewxz/0hgDM121WvAdLHvkBWQRQJObeLbySeEOY5zKCpMc5f8plGQfUU+/H6y6finaBXB9CNuMqkT8Vmyig3RaxZ+q6n7A4cEK38gXz56NhgQCVO9QHKBwf/D/bCsLlB+yNjP1iOPsD7ZqHhaygWwUIKY5Stj3ZvbVwsyQGivpQoqdVjbyEqtYnZja0/wvAW4ayYZtTRoeWfrzI7ntOVNr2w39q3pwv9ALtxrM9ypRbEnvY7mZMbXI6nRyQektCM2HDwDPUHlX7ODVJ3bZrRdcBlGfhWWVFZorQC0WVZSadbibiqpuyo1BVcFqd8=
2022-09-29T10:49:02.288 INFO:teuthology.kill:2022-09-29 10:49:02,287.287 INFO:teuthology.nuke:Checking targets against current locks
2022-09-29T10:49:02.369 INFO:teuthology.kill:2022-09-29 10:49:02,369.369 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-29T10:49:02.400 INFO:teuthology.kill:2022-09-29 10:49:02,400.400 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-29T10:49:02.477 INFO:teuthology.kill:2022-09-29 10:49:02,476.476 INFO:teuthology.orchestra.console:Power off smithi043
2022-09-29T10:49:02.526 INFO:teuthology.kill:2022-09-29 10:49:02,525.525 INFO:teuthology.orchestra.console:Power off smithi053
2022-09-29T10:49:10.869 INFO:teuthology.kill:2022-09-29 10:49:10,869.869 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2022-09-29T10:49:11.020 INFO:teuthology.kill:2022-09-29 10:49:11,019.019 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2022-09-29T10:49:15.020 INFO:teuthology.kill:2022-09-29 10:49:15,020.020 INFO:teuthology.orchestra.console:Power off for smithi053 completed
2022-09-29T10:49:15.171 INFO:teuthology.kill:2022-09-29 10:49:15,171.171 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com
2022-09-29T10:51:15.558 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15