2022-10-22T08:55:50.818 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-22T08:55:50.974 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2022-10-22T08:55:50.976 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T08:55:50.976 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-10-22T08:55:51.010 INFO:teuthology.lock.ops:Node 'smithi003.front.sepia.ceph.com' reimaging is complete
2022-10-22T08:55:51.011 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging
2022-10-22T08:55:51.012 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T08:55:51.012 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2022-10-22T08:55:51.035 INFO:teuthology.lock.ops:Node 'smithi080.front.sepia.ceph.com' reimaging is complete
2022-10-22T08:55:51.242 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6
2022-10-22T08:55:51.264 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.6
2022-10-22T08:55:51.684 INFO:teuthology.orchestra.console:Power off smithi003
2022-10-22T08:55:51.706 INFO:teuthology.orchestra.console:Power off smithi080
2022-10-22T08:55:51.845 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-10-22T08:55:51.858 INFO:teuthology.orchestra.console:Power off for smithi080 completed
2022-10-22T08:55:51.947 INFO:teuthology.orchestra.console:Power on smithi003
2022-10-22T08:55:51.960 INFO:teuthology.orchestra.console:Power on smithi080
2022-10-22T08:55:56.204 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2022-10-22T08:55:56.305 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2022-10-22T08:56:00.328 INFO:teuthology.orchestra.console:Power on for smithi080 completed
2022-10-22T08:56:00.430 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2022-10-22T08:58:12.660 ERROR:teuthology.orchestra.connection:Error authenticating with smithi003.front.sepia.ceph.com: Authentication failed.
2022-10-22T09:00:04.268 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T09:00:12.422 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T09:00:12.670 INFO:teuthology.provision.fog.smithi003:Node is ready
2022-10-22T09:00:12.732 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2022-10-22T09:00:12.797 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2022-10-22T09:00:13.165 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2022-10-22T09:00:29.885 INFO:teuthology.provision.fog.smithi080:Node is ready
2022-10-22T09:00:29.905 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2022-10-22T09:00:29.962 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2022-10-22T09:00:30.332 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2022-10-22T09:00:30.516 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2022-10-22T09:00:30.517 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T09:00:30.539 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com
2022-10-22T09:00:30.540 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T09:00:30.560 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2022-10-22T09:00:30.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-10-22T09:00:30.780 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2022-10-22T09:00:30.841 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux"
2022-10-22T09:00:30.842 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)"
2022-10-22T09:00:30.842 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel"
2022-10-22T09:00:30.842 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora"
2022-10-22T09:00:30.843 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6"
2022-10-22T09:00:30.843 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2022-10-22T09:00:30.843 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-22T09:00:30.844 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2022-10-22T09:00:30.844 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-22T09:00:30.844 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/"
2022-10-22T09:00:30.844 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-22T09:00:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-22T09:00:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:
2022-10-22T09:00:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-22T09:00:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-22T09:00:30.846 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-22T09:00:30.846 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-22T09:00:30.848 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-10-22T09:00:30.869 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server
2022-10-22T09:00:30.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2022-10-22T09:00:31.076 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64
2022-10-22T09:00:31.133 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux"
2022-10-22T09:00:31.134 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)"
2022-10-22T09:00:31.135 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel"
2022-10-22T09:00:31.135 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora"
2022-10-22T09:00:31.135 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6"
2022-10-22T09:00:31.136 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2022-10-22T09:00:31.136 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-22T09:00:31.136 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2022-10-22T09:00:31.136 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-22T09:00:31.137 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/"
2022-10-22T09:00:31.137 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-22T09:00:31.137 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-22T09:00:31.137 INFO:teuthology.orchestra.run.smithi080.stdout:
2022-10-22T09:00:31.138 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-22T09:00:31.138 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-22T09:00:31.138 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-22T09:00:31.138 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-22T09:00:31.139 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2022-10-22T09:00:31.253 INFO:teuthology.dispatcher.supervisor:Running job 7077287
2022-10-22T09:00:31.253 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-10-21_15:23:05-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi/7077287 --name yuriw-2022-10-21_15:23:05-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-10-21_15:23:05-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi/7077287/orig.config.yaml
2022-10-22T09:00:31.258 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-10-21_15:23:05-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi/7077287
2022-10-22T09:00:31.259 INFO:teuthology.dispatcher.supervisor:Job PID: 14051
2022-10-22T09:00:31.260 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-10-22T21:00:54.664 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-10-22T21:00:54.813 INFO:teuthology.kill:Killing Pids: {14051}
2022-10-22T21:00:56.347 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-10-22T21:00:56.348 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-10-22T21:00:56.349 INFO:teuthology.misc:Compressing logs...
2022-10-22T21:00:56.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-10-22T21:00:56.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2022-10-22T21:00:56.941 INFO:teuthology.misc:Compressing logs...
2022-10-22T21:00:57.964 INFO:teuthology.orchestra.run.smithi080.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-10-22T21:00:58.075 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-10-22T21:00:58.698 INFO:teuthology.misc:Compressing logs...
2022-10-22T21:02:11.556 INFO:teuthology.kill:No teuthology processes running
2022-10-22T21:02:13.139 INFO:teuthology.kill:Nuking machines: ['smithi003', 'smithi080']
2022-10-22T21:02:14.390 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-10-22T21:02:14.391 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-10-22T21:02:14.391 INFO:teuthology.kill:2022-10-22 21:02:14,390.390 INFO:teuthology.nuke:targets:
2022-10-22T21:02:14.392 INFO:teuthology.kill:  smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB1SL9Pr5fDGcNC7NRJTnamC3O/1GxjfDQC9hGolxs9uYbXYco6wOVfHtFeQOFtnbTZtU1nGj3Yo3xgnwDPkK4k=
2022-10-22T21:02:14.392 INFO:teuthology.kill:  smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYHv+a2BmpRJoDHYQ4/icn1pNIR4pKE6yiw4nY7A469Bk1R92jLB4RBOjz1h4jdsbLH1ydZPa8oSTUR8PuuMIEgSKCRvsd/WkE+iDu3fDPf5p6TXSGKIFHJxzUnoOuKYSZMM1aLAjF/X3cT5a24b7Ei3H/roVW28/K95+SdgElHNyZWOkrBxmmY11LwLOig8fGivXsjVrveWkXlle3BnzhX0M0o6PoiAsOelsoVcYEIWmwxAVudnC68jkPvJnkUi0VhzGPuAnXWgkMKb3qo++iEL7Qflf6c5YcekiC45CUSTK1XRHJ551Rdsx8nK1iClq6Ak2sNJHL4ZPuCDC46ozYAiGjloWlHAU0SmCe9dXbpdt4qhJunQC8QgyCN+VEy+Jbj43T3zFUnEG9WTbEtoM9Jc4O+S7I8iDXNTtSO55zE4Bg2LluuwtPQ8lEMCJBglXfZwV1U6IgRCpAbALoblwuB3na734pqE5YypKLJ+5w6CaczoAE7YIsfl9IdJBAIWs=
2022-10-22T21:02:14.392 INFO:teuthology.kill:2022-10-22 21:02:14,390.390 INFO:teuthology.nuke:Checking targets against current locks
2022-10-22T21:02:14.443 INFO:teuthology.kill:2022-10-22 21:02:14,443.443 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-22T21:02:14.470 INFO:teuthology.kill:2022-10-22 21:02:14,470.470 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-22T21:02:14.538 INFO:teuthology.kill:2022-10-22 21:02:14,538.538 INFO:teuthology.orchestra.console:Power off smithi003
2022-10-22T21:02:14.579 INFO:teuthology.kill:2022-10-22 21:02:14,579.579 INFO:teuthology.orchestra.console:Power off smithi080
2022-10-22T21:02:22.918 INFO:teuthology.kill:2022-10-22 21:02:22,917.917 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-10-22T21:02:22.949 INFO:teuthology.kill:2022-10-22 21:02:22,948.948 INFO:teuthology.orchestra.console:Power off for smithi080 completed
2022-10-22T21:02:23.085 INFO:teuthology.kill:2022-10-22 21:02:23,084.084 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2022-10-22T21:02:23.106 INFO:teuthology.kill:2022-10-22 21:02:23,106.106 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com
2022-10-22T21:04:23.334 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-10-22T21:04:23.441 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi003 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:nautilus-x-pacific-distro-default-smithi/7077373
2022-10-22T21:04:23.442 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:nautilus-x-pacific-distro-default-smithi/7077373