2022-09-29T17:14:22.669 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-09-29T17:14:22.823 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2022-09-29T17:14:22.824 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2022-09-29T17:14:22.825 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2022-09-29T17:14:22.845 INFO:teuthology.lock.ops:Node 'smithi094.front.sepia.ceph.com' reimaging is complete
2022-09-29T17:14:22.845 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2022-09-29T17:14:22.845 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2022-09-29T17:14:22.846 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2022-09-29T17:14:22.875 INFO:teuthology.lock.ops:Node 'smithi106.front.sepia.ceph.com' reimaging is complete
2022-09-29T17:14:23.067 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of rhel 8.6
2022-09-29T17:14:23.089 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of rhel 8.6
2022-09-29T17:14:23.436 INFO:teuthology.orchestra.console:Power off smithi094
2022-09-29T17:14:23.455 INFO:teuthology.orchestra.console:Power off smithi106
2022-09-29T17:14:31.818 INFO:teuthology.orchestra.console:Power off for smithi094 completed
2022-09-29T17:14:31.919 INFO:teuthology.orchestra.console:Power on smithi094
2022-09-29T17:14:35.939 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2022-09-29T17:14:36.041 INFO:teuthology.orchestra.console:Power on smithi106
2022-09-29T17:14:40.291 INFO:teuthology.orchestra.console:Power on for smithi094 completed
2022-09-29T17:14:40.393 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2022-09-29T17:14:44.413 INFO:teuthology.orchestra.console:Power on for smithi106 completed
2022-09-29T17:14:44.514 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2022-09-29T17:17:11.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi094.front.sepia.ceph.com: Authentication failed.
2022-09-29T17:18:52.663 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-29T17:19:12.990 INFO:teuthology.provision.fog.smithi094:Node is ready
2022-09-29T17:19:13.013 INFO:teuthology.orchestra.run.smithi094.stdout:smithi055
2022-09-29T17:19:13.270 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2022-09-29T17:19:22.549 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-29T17:19:22.810 INFO:teuthology.provision.fog.smithi106:Node is ready
2022-09-29T17:19:22.867 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2022-09-29T17:19:22.925 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2022-09-29T17:19:23.263 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2022-09-29T17:19:23.487 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2022-09-29T17:19:23.489 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-29T17:19:23.521 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2022-09-29T17:19:23.521 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-29T17:19:23.553 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2022-09-29T17:19:23.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2022-09-29T17:19:23.847 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2022-09-29T17:19:23.906 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux"
2022-09-29T17:19:23.968 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)"
2022-09-29T17:19:23.968 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel"
2022-09-29T17:19:23.968 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora"
2022-09-29T17:19:23.968 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6"
2022-09-29T17:19:23.969 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8"
2022-09-29T17:19:23.969 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-29T17:19:23.969 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2022-09-29T17:19:23.969 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-29T17:19:23.970 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/"
2022-09-29T17:19:23.970 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-29T17:19:23.970 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-29T17:19:23.970 INFO:teuthology.orchestra.run.smithi094.stdout:
2022-09-29T17:19:23.971 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-29T17:19:23.971 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-29T17:19:23.971 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-29T17:19:23.971 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-29T17:19:23.973 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2022-09-29T17:19:23.995 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2022-09-29T17:19:23.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2022-09-29T17:19:24.223 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2022-09-29T17:19:24.284 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux"
2022-09-29T17:19:24.284 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)"
2022-09-29T17:19:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel"
2022-09-29T17:19:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora"
2022-09-29T17:19:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6"
2022-09-29T17:19:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2022-09-29T17:19:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-29T17:19:24.286 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2022-09-29T17:19:24.286 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-29T17:19:24.287 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/"
2022-09-29T17:19:24.287 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-29T17:19:24.287 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-29T17:19:24.287 INFO:teuthology.orchestra.run.smithi106.stdout:
2022-09-29T17:19:24.287 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-29T17:19:24.288 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-29T17:19:24.288 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-29T17:19:24.288 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-29T17:19:24.289 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2022-09-29T17:19:24.423 INFO:teuthology.dispatcher.supervisor:Running job 7047727
2022-09-29T17:19:24.424 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-09-29_16:40:30-rados-wip-all-kickoff-r-distro-default-smithi/7047727 --name yuriw-2022-09-29_16:40:30-rados-wip-all-kickoff-r-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-09-29_16:40:30-rados-wip-all-kickoff-r-distro-default-smithi/7047727/orig.config.yaml
2022-09-29T17:19:24.431 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-09-29_16:40:30-rados-wip-all-kickoff-r-distro-default-smithi/7047727
2022-09-29T17:19:24.432 INFO:teuthology.dispatcher.supervisor:Job PID: 14957
2022-09-29T17:19:24.432 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-30T05:19:49.360 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-30T05:19:50.133 INFO:teuthology.kill:Killing Pids: {14957}
2022-09-30T05:19:52.072 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-30T05:19:52.074 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-30T05:19:52.082 INFO:teuthology.misc:Compressing logs...
2022-09-30T05:19:52.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2022-09-30T05:19:53.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2022-09-30T05:19:53.916 INFO:teuthology.misc:Compressing logs...
2022-09-30T05:19:54.979 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-30T05:19:54.988 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-30T05:19:55.762 INFO:teuthology.misc:Compressing logs...
2022-09-30T05:23:29.870 INFO:teuthology.kill:No teuthology processes running
2022-09-30T05:23:31.327 INFO:teuthology.kill:Nuking machines: ['smithi094', 'smithi106']
2022-09-30T05:23:32.576 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-30T05:23:32.577 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-30T05:23:32.577 INFO:teuthology.kill:2022-09-30 05:23:32,576.576 INFO:teuthology.nuke:targets:
2022-09-30T05:23:32.578 INFO:teuthology.kill:  smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmYunlgyYqdN3/4svcJYeJqinBu4c/jbHDXs66mzSEzFurPA9S1JBv1b44DkuUNjzi9WC1TlfERtL6BVn3R+V8vRbCbKNiJccVIipDvyf9/ZBt17/7YEwoEXS/qs3/2b+MMf6tmjch4IgHjnuEgvNvHNxdK0O9SQQdeXsWjWFcUcEBWjJA91t2oZDnMUjVKQDa0HqCX93ps1o7rtUZlV7wKzRHNmEgjEMrfEv8geiyEmPjU6bTn28dvkLmh31kUZ0GlEC0UdBm6WJRtqxIdj5ocsWF8inBCDgiaMzAsf7vEJq5rIHgqk+Vjd+Ss5Ou9fMFM6tarKXHCQ93lPs4/ZGI4uWkW5U2blnsK1qhNonFQT8vV5m1kDTA7SVn4YQpV+yUrLvSOaivDY+6pdORB1rxaiYzS7e/a9FwBpMK4Uvp9iaAwu2uF8nuT4ET2zUhtBba8nnYZfYuINO+THJgOa3VlrkgHmQ/zN/KHhI5akmhH/gqAf8OE9PYDFmbf6I61CM=
2022-09-30T05:23:32.578 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT9Bhev8YVB8P/KcXz2qSmvcNB+13tQqRSo/1DPy/BpiR4q3bI5ZBvdFyVL6AbsxKtyVwZ5HLgrwGK/1P1s8aQomfPE7p8T6SXLjBc0LVZZGyutbksHbuw4WVeq25UkjXu7o4505GLc0jgFuXziSI2i9V7/fiXuqfMxFGba0hbW1C5OU4eJpbufiNZ8sIoYgsCO2fJqeC2c3LfPn3EHHkYApDGrXD9SlH3aP+ElGZK3dL0vHvVAEBtiPH26M/kCv08TZyccdV+JmKtDbakLnme65JJViVFMBotLcn1ODOJ7neloDQKXdWk3f75oqGh92dpZ3SRKFhWtZ24gJEg6DduyY/5rG7jSZ33uyIMJ/oTK+BFe5GKrfbifJAdUQtjHT3sKvkPxjs3bQsFIwFlwWUdKWFto+QcaGRvmNPqdNJ4Xeoy5RSKjZGDniKAFW1dlZpr3IyjjXkSjxWUkIjjvKbI9Ei3hALPx739N6iZp037nv4EefUU2Q6s/n9SIYAwOp8=
2022-09-30T05:23:32.579 INFO:teuthology.kill:2022-09-30 05:23:32,579.579 INFO:teuthology.nuke:Checking targets against current locks
2022-09-30T05:23:32.638 INFO:teuthology.kill:2022-09-30 05:23:32,638.638 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-30T05:23:32.680 INFO:teuthology.kill:2022-09-30 05:23:32,680.680 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-30T05:23:32.748 INFO:teuthology.kill:2022-09-30 05:23:32,748.748 INFO:teuthology.orchestra.console:Power off smithi094
2022-09-30T05:23:32.810 INFO:teuthology.kill:2022-09-30 05:23:32,809.809 INFO:teuthology.orchestra.console:Power off smithi106
2022-09-30T05:23:41.150 INFO:teuthology.kill:2022-09-30 05:23:41,147.147 INFO:teuthology.orchestra.console:Power off for smithi094 completed
2022-09-30T05:23:41.298 INFO:teuthology.kill:2022-09-30 05:23:41,297.297 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com
2022-09-30T05:23:45.319 INFO:teuthology.kill:2022-09-30 05:23:45,319.319 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2022-09-30T05:23:45.476 INFO:teuthology.kill:2022-09-30 05:23:45,475.475 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com
2022-09-30T05:25:45.780 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-30T05:25:45.906 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi094 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-09-30_05:09:47-rados:thrash-wip-rf-tout-distro-default-smithi/7048969
2022-09-30T05:25:45.908 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi106 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-09-30_05:09:47-rados:thrash-wip-rf-tout-distro-default-smithi/7048969