2022-09-28T22:40:58.710 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-09-28T22:40:58.836 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2022-09-28T22:40:58.837 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2022-09-28T22:40:58.837 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2022-09-28T22:40:58.858 INFO:teuthology.lock.ops:Node 'smithi032.front.sepia.ceph.com' reimaging is complete
2022-09-28T22:40:58.858 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2022-09-28T22:40:58.858 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2022-09-28T22:40:58.859 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-09-28T22:40:58.878 INFO:teuthology.lock.ops:Node 'smithi052.front.sepia.ceph.com' reimaging is complete
2022-09-28T22:40:59.067 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6
2022-09-28T22:40:59.079 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of rhel 8.6
2022-09-28T22:40:59.357 INFO:teuthology.orchestra.console:Power off smithi032
2022-09-28T22:40:59.372 INFO:teuthology.orchestra.console:Power off smithi052
2022-09-28T22:40:59.503 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2022-09-28T22:40:59.515 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-09-28T22:40:59.605 INFO:teuthology.orchestra.console:Power on smithi032
2022-09-28T22:40:59.617 INFO:teuthology.orchestra.console:Power on smithi052
2022-09-28T22:41:03.861 INFO:teuthology.orchestra.console:Power on for smithi032 completed
2022-09-28T22:41:03.866 INFO:teuthology.orchestra.console:Power on for smithi052 completed
2022-09-28T22:41:03.962 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2022-09-28T22:41:03.966 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2022-09-28T22:44:49.245 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-28T22:45:08.702 INFO:teuthology.provision.fog.smithi052:Node is ready
2022-09-28T22:45:08.721 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2022-09-28T22:45:08.779 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2022-09-28T22:45:09.137 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2022-09-28T22:45:24.037 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-28T22:45:24.296 INFO:teuthology.provision.fog.smithi032:Node is ready
2022-09-28T22:45:24.315 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2022-09-28T22:45:24.374 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2022-09-28T22:45:24.733 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2022-09-28T22:45:24.982 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2022-09-28T22:45:24.983 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-28T22:45:25.005 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2022-09-28T22:45:25.005 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-28T22:45:25.024 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2022-09-28T22:45:25.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2022-09-28T22:45:25.218 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2022-09-28T22:45:25.275 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2022-09-28T22:45:25.275 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2022-09-28T22:45:25.276 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2022-09-28T22:45:25.276 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2022-09-28T22:45:25.276 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2022-09-28T22:45:25.276 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2022-09-28T22:45:25.277 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-28T22:45:25.277 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2022-09-28T22:45:25.277 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-28T22:45:25.277 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2022-09-28T22:45:25.277 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-28T22:45:25.278 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-28T22:45:25.278 INFO:teuthology.orchestra.run.smithi032.stdout:
2022-09-28T22:45:25.278 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-28T22:45:25.278 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-28T22:45:25.279 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-28T22:45:25.279 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-28T22:45:25.280 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2022-09-28T22:45:25.299 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2022-09-28T22:45:25.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-09-28T22:45:25.566 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2022-09-28T22:45:25.624 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux"
2022-09-28T22:45:25.625 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)"
2022-09-28T22:45:25.625 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel"
2022-09-28T22:45:25.625 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora"
2022-09-28T22:45:25.625 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6"
2022-09-28T22:45:25.626 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2022-09-28T22:45:25.626 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-28T22:45:25.626 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2022-09-28T22:45:25.626 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-28T22:45:25.627 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/"
2022-09-28T22:45:25.627 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-28T22:45:25.627 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-28T22:45:25.627 INFO:teuthology.orchestra.run.smithi052.stdout:
2022-09-28T22:45:25.627 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-28T22:45:25.628 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-28T22:45:25.628 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-28T22:45:25.628 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-28T22:45:25.629 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-09-28T22:45:25.728 INFO:teuthology.dispatcher.supervisor:Running job 7046987
2022-09-28T22:45:25.729 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046987 --name lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi --description upgrade:telemetry-upgrade/pacific-x/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic} -- /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046987/orig.config.yaml
2022-09-28T22:45:25.735 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-28_22:40:07-upgrade:telemetry-upgrade-wip-telemetry-perf-fix-distro-default-smithi/7046987
2022-09-28T22:45:25.736 INFO:teuthology.dispatcher.supervisor:Job PID: 7780
2022-09-28T22:45:25.737 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-29T10:46:16.857 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-29T10:46:17.529 INFO:teuthology.kill:Killing Pids: {7780}
2022-09-29T10:46:28.182 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-09-29T10:46:28.186 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-09-29T10:46:28.186 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:28.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2022-09-29T10:46:28.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-09-29T10:46:29.383 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:30.091 INFO:teuthology.misc:Compressing logs...
2022-09-29T10:46:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-09-29T10:46:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-09-29T10:46:49.883 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-09-29T10:46:50.567 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-09-29T10:46:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-09-29T10:47:00.281 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-09-29T10:47:10.101 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-09-29T10:47:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-09-29T10:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-09-29T10:47:18.427 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-09-29T10:47:33.124 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-09-29T10:47:37.316 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/fdf199fe-3f80-11ed-8431-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-09-29T10:48:59.775 INFO:teuthology.kill:No teuthology processes running
2022-09-29T10:49:01.266 INFO:teuthology.kill:Nuking machines: ['smithi032', 'smithi052']
2022-09-29T10:49:02.773 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-29T10:49:02.775 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-29T10:49:02.775 INFO:teuthology.kill:2022-09-29 10:49:02,773.773 INFO:teuthology.nuke:targets:
2022-09-29T10:49:02.776 INFO:teuthology.kill:  smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD6jrlj7UEbPWem1wYHRPgtMaSfYYsOWB9tNzOticWe5dA05wUVZiJigyPB1OpJsy/tqVviD8EPb0AAaBlfDG28=
2022-09-29T10:49:02.776 INFO:teuthology.kill:  smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC45EQTmugooMr6m5m2pt1eT5O802zBeoJgPjhJukn1d8aVwmvR4IT6gx6eFMvj0NAAu2tlR8S+4xWvNzja85tbUHJadmqOIIFYj6p6uYLWhLp/R2QcVwQ9kHcByqLj9W/A3eHBXX67ZxESXDT2eSQmJh/PL2BSkjxVUAs1gDeuhHupHqTsmYoCuHVP85NmAo5FliQe+zEJ/Oo6yQMwDBzEo7JwTpbicmGz+jHTikT7A8KKOIQbYjvd1JtGJbc3hEkzh88lTR2hBFzOhVl5VfLIvk+gYmxkfWDP+7mVJ2/1MjME/X7WMNrjgxuIZoxpDUdRJ8ecaGj0PIUcJoEU/JYKqHQReaF0Fhv6lAffnXyCDhFpB+Q5Wvz3AVkjRHI58D4uBNdCJQMW8/A7Udlx1gasfAeprYWH5B5eqDpjTXqXv6B9cD6BZvLzamyF7h5PzxryIpHWG+f02MQlxM5ycGeWEwziVvSfCxkMm/xoR4FWb0gU1iUJeXGirGtH1ML9Ym8=
2022-09-29T10:49:02.777 INFO:teuthology.kill:2022-09-29 10:49:02,773.773 INFO:teuthology.nuke:Checking targets against current locks
2022-09-29T10:49:02.829 INFO:teuthology.kill:2022-09-29 10:49:02,828.828 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-29T10:49:02.862 INFO:teuthology.kill:2022-09-29 10:49:02,861.861 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-29T10:49:02.942 INFO:teuthology.kill:2022-09-29 10:49:02,941.941 INFO:teuthology.orchestra.console:Power off smithi032
2022-09-29T10:49:02.990 INFO:teuthology.kill:2022-09-29 10:49:02,989.989 INFO:teuthology.orchestra.console:Power off smithi052
2022-09-29T10:49:11.368 INFO:teuthology.kill:2022-09-29 10:49:11,367.367 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2022-09-29T10:49:11.543 INFO:teuthology.kill:2022-09-29 10:49:11,542.542 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2022-09-29T10:49:15.504 INFO:teuthology.kill:2022-09-29 10:49:15,503.503 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-09-29T10:49:15.670 INFO:teuthology.kill:2022-09-29 10:49:15,670.670 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2022-09-29T10:51:16.027 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15