2022-10-22T14:45:50.412 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-22T14:45:50.584 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2022-10-22T14:45:50.585 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T14:45:50.586 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-10-22T14:45:50.612 INFO:teuthology.lock.ops:Node 'smithi008.front.sepia.ceph.com' reimaging is complete
2022-10-22T14:45:50.612 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2022-10-22T14:45:50.613 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T14:45:50.614 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2022-10-22T14:45:50.635 INFO:teuthology.lock.ops:Node 'smithi063.front.sepia.ceph.com' reimaging is complete
2022-10-22T14:45:50.834 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6
2022-10-22T14:45:50.854 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6
2022-10-22T14:45:51.170 INFO:teuthology.orchestra.console:Power off smithi008
2022-10-22T14:45:51.225 INFO:teuthology.orchestra.console:Power off smithi063
2022-10-22T14:45:59.563 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-10-22T14:45:59.664 INFO:teuthology.orchestra.console:Power on smithi008
2022-10-22T14:46:03.714 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2022-10-22T14:46:03.816 INFO:teuthology.orchestra.console:Power on smithi063
2022-10-22T14:46:08.042 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2022-10-22T14:46:08.071 INFO:teuthology.orchestra.console:Power on for smithi063 completed
2022-10-22T14:46:08.143 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2022-10-22T14:46:08.173 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2022-10-22T14:50:37.113 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T14:50:37.369 INFO:teuthology.provision.fog.smithi008:Node is ready
2022-10-22T14:50:37.388 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2022-10-22T14:50:37.449 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2022-10-22T14:50:37.818 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2022-10-22T14:50:52.174 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T14:50:52.447 INFO:teuthology.provision.fog.smithi063:Node is ready
2022-10-22T14:50:52.509 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2022-10-22T14:50:52.572 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2022-10-22T14:50:52.943 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2022-10-22T14:50:53.145 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2022-10-22T14:50:53.146 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T14:50:53.171 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2022-10-22T14:50:53.171 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T14:50:53.193 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2022-10-22T14:50:53.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-10-22T14:50:53.464 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2022-10-22T14:50:53.522 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux"
2022-10-22T14:50:53.523 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)"
2022-10-22T14:50:53.523 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel"
2022-10-22T14:50:53.524 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora"
2022-10-22T14:50:53.524 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6"
2022-10-22T14:50:53.524 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2022-10-22T14:50:53.525 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-22T14:50:53.525 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2022-10-22T14:50:53.525 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-22T14:50:53.526 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/"
2022-10-22T14:50:53.526 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-22T14:50:53.526 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-22T14:50:53.526 INFO:teuthology.orchestra.run.smithi008.stdout:
2022-10-22T14:50:53.527 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-22T14:50:53.527 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-22T14:50:53.527 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-22T14:50:53.528 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-22T14:50:53.530 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-10-22T14:50:53.550 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2022-10-22T14:50:53.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2022-10-22T14:50:53.765 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2022-10-22T14:50:53.827 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2022-10-22T14:50:53.827 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)"
2022-10-22T14:50:53.828 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2022-10-22T14:50:53.828 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2022-10-22T14:50:53.828 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6"
2022-10-22T14:50:53.829 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2022-10-22T14:50:53.829 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-22T14:50:53.829 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2022-10-22T14:50:53.830 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-22T14:50:53.830 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2022-10-22T14:50:53.831 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-22T14:50:53.831 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-22T14:50:53.831 INFO:teuthology.orchestra.run.smithi063.stdout:
2022-10-22T14:50:53.832 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-22T14:50:53.832 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-22T14:50:53.832 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-22T14:50:53.833 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-22T14:50:53.833 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2022-10-22T14:50:53.960 INFO:teuthology.dispatcher.supervisor:Running job 7077393
2022-10-22T14:50:53.961 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:quincy-x-main-distro-default-smithi/7077393 --name teuthology-2022-10-22_14:23:03-upgrade:quincy-x-main-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:quincy-x-main-distro-default-smithi/7077393/orig.config.yaml
2022-10-22T14:50:53.967 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:quincy-x-main-distro-default-smithi/7077393
2022-10-22T14:50:53.967 INFO:teuthology.dispatcher.supervisor:Job PID: 25988
2022-10-22T14:50:53.968 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-10-23T02:51:47.310 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-10-23T02:51:47.524 INFO:teuthology.kill:Killing Pids: {25988}
2022-10-23T02:51:48.975 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-10-23T02:51:48.976 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-10-23T02:51:48.976 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:51:48.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-10-23T02:51:49.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2022-10-23T02:51:49.505 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:51:49.745 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-10-23T02:51:49.900 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:52:00.484 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-10-23T02:52:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-10-23T02:52:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-10-23T02:52:14.780 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-10-23T02:52:29.246 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-10-23T02:52:30.522 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-10-23T02:52:43.711 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-10-23T02:52:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-10-23T02:52:55.137 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-10-23T02:52:58.053 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-10-23T02:53:29.035 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-10-23T02:53:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/adf22de0-521a-11ed-8438-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-10-23T02:54:12.157 INFO:teuthology.kill:No teuthology processes running
2022-10-23T02:54:13.519 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi063']
2022-10-23T02:54:14.717 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-10-23T02:54:14.718 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-10-23T02:54:14.718 INFO:teuthology.kill:2022-10-23 02:54:14,716.716 INFO:teuthology.nuke:targets:
2022-10-23T02:54:14.733 INFO:teuthology.kill:  smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnFUIHX+87u5Gm5qzWeOi8uMGWbZD1y/gt65PSkL/AU6wrXWZ9cQetXqu3JlVywVhQCnRFW7R3a53n8gzWabPA=
2022-10-23T02:54:14.733 INFO:teuthology.kill:  smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RR4ngfO3zXIc3YZI6luhsG0FcTanSUjwvADSDrwKcC6+onw0mGfNDXAev0LB8AlKC070YBjIQyrdMZ69mKlgspp9GfhPypX/V5hnryHmkVUe4kUNYQVUoxU0p4jff/fxzKUzM6zOKTrsUKIhHD8G1cLAJ6W3uZ3mB6XqB+D8KR+bAJDanUwQcO6ClsiPRTCAOKCD3/v7iGKjSVU1igiFFKQL29Xnr9oW2i1Zl42AcqSACuThWN9lI4Yt8hzERSywL0l41GpQAkmRIOug9ys6ks5IRxbNs0PUj2/kQHgvI4RBScizJTL24QDsaiRaCVB/2KZT2wFxS0El4zDOA+J2eVlvRov74rDuqMuHgyeMhQ3D23CG3Ix33g8xkv4b25UN0Uk1r5ZeUJhd2fbfz3n7ARnu2zVp67omrqR6OUINFHuiCgiFhTeJtf7F64J/YFMHoK6UgTG55jv9kwISvHXgijcVOMMuz2vJylKhUpjpxxTGatG6/7Og8PDTUdywGnE=
2022-10-23T02:54:14.734 INFO:teuthology.kill:2022-10-23 02:54:14,731.731 INFO:teuthology.nuke:Checking targets against current locks
2022-10-23T02:54:14.789 INFO:teuthology.kill:2022-10-23 02:54:14,788.788 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-23T02:54:14.823 INFO:teuthology.kill:2022-10-23 02:54:14,823.823 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-23T02:54:14.884 INFO:teuthology.kill:2022-10-23 02:54:14,884.884 INFO:teuthology.orchestra.console:Power off smithi008
2022-10-23T02:54:14.921 INFO:teuthology.kill:2022-10-23 02:54:14,920.920 INFO:teuthology.orchestra.console:Power off smithi063
2022-10-23T02:54:23.253 INFO:teuthology.kill:2022-10-23 02:54:23,253.253 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-10-23T02:54:23.404 INFO:teuthology.kill:2022-10-23 02:54:23,402.402 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2022-10-23T02:54:27.399 INFO:teuthology.kill:2022-10-23 02:54:27,398.398 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2022-10-23T02:54:27.548 INFO:teuthology.kill:2022-10-23 02:54:27,548.548 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com
2022-10-23T02:56:27.931 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-10-23T02:56:28.104 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069349
2022-10-23T02:56:28.105 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi063 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069349