2022-04-12T11:13:44.054 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-12T11:13:44.176 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging
2022-04-12T11:13:44.177 INFO:teuthology.lock.ops:Updating [ubuntu@smithi090.front.sepia.ceph.com]: reset os type and version on server
2022-04-12T11:13:44.177 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-04-12T11:13:44.196 INFO:teuthology.lock.ops:Node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging is complete
2022-04-12T11:13:44.196 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging
2022-04-12T11:13:44.198 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server
2022-04-12T11:13:44.198 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-04-12T11:13:44.217 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete
2022-04-12T11:13:44.407 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of rhel 8.5
2022-04-12T11:13:44.418 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.5
2022-04-12T11:13:44.757 INFO:teuthology.orchestra.console:Power off smithi090
2022-04-12T11:13:44.771 INFO:teuthology.orchestra.console:Power off smithi145
2022-04-12T11:13:53.146 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-04-12T11:13:53.247 INFO:teuthology.orchestra.console:Power on smithi145
2022-04-12T11:13:57.247 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-04-12T11:13:57.349 INFO:teuthology.orchestra.console:Power on smithi090
2022-04-12T11:14:01.606 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2022-04-12T11:14:01.681 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2022-04-12T11:14:01.708 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2022-04-12T11:14:01.783 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2022-04-12T11:17:32.897 ERROR:teuthology.orchestra.connection:Error authenticating with smithi145.front.sepia.ceph.com: Authentication timeout.
2022-04-12T11:18:15.755 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-04-12T11:18:40.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-12T11:18:40.380 INFO:teuthology.provision.fog.smithi145:Node is ready
2022-04-12T11:18:40.397 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2022-04-12T11:18:40.454 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2022-04-12T11:18:40.785 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2022-04-12T11:19:34.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-12T11:19:34.414 INFO:teuthology.provision.fog.smithi090:Node is ready
2022-04-12T11:19:34.431 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2022-04-12T11:19:34.488 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2022-04-12T11:19:34.846 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2022-04-12T11:19:35.036 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2022-04-12T11:19:35.037 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-12T11:19:35.059 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2022-04-12T11:19:35.059 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-12T11:19:35.076 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2022-04-12T11:19:35.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-04-12T11:19:35.261 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2022-04-12T11:19:35.316 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux"
2022-04-12T11:19:35.316 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.5 (Ootpa)"
2022-04-12T11:19:35.316 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel"
2022-04-12T11:19:35.317 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora"
2022-04-12T11:19:35.317 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.5"
2022-04-12T11:19:35.317 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2022-04-12T11:19:35.317 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)"
2022-04-12T11:19:35.318 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2022-04-12T11:19:35.318 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-04-12T11:19:35.318 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/"
2022-04-12T11:19:35.318 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-12T11:19:35.319 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-12T11:19:35.319 INFO:teuthology.orchestra.run.smithi090.stdout:
2022-04-12T11:19:35.319 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-12T11:19:35.319 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5
2022-04-12T11:19:35.319 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-12T11:19:35.320 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5"
2022-04-12T11:19:35.321 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-04-12T11:19:35.345 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2022-04-12T11:19:35.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-04-12T11:19:35.587 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2022-04-12T11:19:35.643 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2022-04-12T11:19:35.643 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.5 (Ootpa)"
2022-04-12T11:19:35.644 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2022-04-12T11:19:35.644 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2022-04-12T11:19:35.644 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.5"
2022-04-12T11:19:35.644 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2022-04-12T11:19:35.645 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)"
2022-04-12T11:19:35.645 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2022-04-12T11:19:35.645 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-04-12T11:19:35.645 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2022-04-12T11:19:35.646 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-12T11:19:35.646 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-12T11:19:35.646 INFO:teuthology.orchestra.run.smithi145.stdout:
2022-04-12T11:19:35.646 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-12T11:19:35.647 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5
2022-04-12T11:19:35.647 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-12T11:19:35.647 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5"
2022-04-12T11:19:35.648 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-04-12T11:19:35.746 INFO:teuthology.dispatcher.supervisor:Running job 6788187
2022-04-12T11:19:35.746 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-11_23:40:29-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6788187 --name yuriw-2022-04-11_23:40:29-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} -- /home/teuthworker/archive/yuriw-2022-04-11_23:40:29-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6788187/orig.config.yaml
2022-04-12T11:19:35.750 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-11_23:40:29-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6788187
2022-04-12T11:19:35.751 INFO:teuthology.dispatcher.supervisor:Job PID: 24865
2022-04-12T11:19:35.752 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-12T17:50:04.329 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-12T17:50:04.514 INFO:teuthology.kill:Killing Pids: {24865}
2022-04-12T17:50:05.763 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-04-12T17:50:05.764 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-04-12T17:50:05.765 INFO:teuthology.misc:Compressing logs...
2022-04-12T17:50:05.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-04-12T17:50:05.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-04-12T17:50:06.247 INFO:teuthology.misc:Compressing logs...
2022-04-12T17:50:06.815 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-04-12T17:50:07.013 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-04-12T17:50:07.410 INFO:teuthology.misc:Compressing logs...
2022-04-12T17:50:27.003 INFO:teuthology.kill:No teuthology processes running
2022-04-12T17:50:28.284 INFO:teuthology.kill:Nuking machines: ['smithi090', 'smithi145']
2022-04-12T17:50:29.245 INFO:teuthology.kill:2022-04-12 17:50:29,245.245 INFO:teuthology.nuke:targets:
2022-04-12T17:50:29.246 INFO:teuthology.kill:  smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnATiEatO/kfrbIyKrLWnsSCA97kzdSuTeHZ5rNwTLNw044bzWdMahIMp1VwQ3abjFmovRC4J3c2Wm5agInVasMBMCDYbkEer5Gbn29wi9aIInnatjElaShA/FRpwek++2cU4AjBLhVOM6LSjyfLck9KJwqgOgBIQLUQlw2kMzuJiQxrCo8PbtnvkPHgSf9v5EDH2CEuXZvFd+GCn2U9e2zTHjeE3ygCkIk/wRuZ7s+A/2gtHFbLrmrBWoqvSVcMKS2+CIV+d9A3Dfdz06dUwrHPMJorAwca82XFLM9tQ/PvubtgYnNGjbYy/M4+OVK6rM/HfddYyTxSjr1EzaVW/jrcKDtlHApIpMh+srtecRVHysvqrzB63QlGEJcDRKeAw0zCuUZoEiDrY/7CF/lWkzfdtoGhbC/IHeTTZzclwKpsV4VeMtFyGl7oPZan/OFJlTl1h/4QzJcPIYMHR01twe+0LvvDg+3+tcDuT9IGPqCri5EIyf+AnaALqsMw0jH9k=
2022-04-12T17:50:29.246 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQd6PhFDdMm36FylIOGQU4hvfcFwKGEyRNu3bpn4GgChasc/A4Y8z/ElT1IVQF4+cmgwnYpZu2NT+RFgPSBnWPAO76r37o23Yd7ZfVwjqxvCGsBIdVhCSZPzFYBHb3ewGV3wMrbKVP6JUu7DbGh8mu5Sxt3rrned/kzvfTBMXHWpwuaM8wHeqPSt3PYL0sZR5bq1KS6fEnKWQM/OsItieHuzMOLZZjAKq/Zax2GPsoipa2nOeMm2i2Ovu1Iit/jyqrtpRxcFT9FM8huMXlM6FsaoTxR2GcXNYLYvAjN4tkl33o2FJuRUL0qOIb2vEprn4VCHHw0hv77G89CO+xj+Be7tcmcBAEdoeF0OTc96IbSCVQuRjS7cmB7CWDd7KibbsoaUfGcCz46KUtguCR4RJgL6G8EOeY1mS5LUtbPZVWcOI8R5e5dAP6rheKvUJOTWeLovnuCBbRHYED/ZarlJak8S1mA92h7txTq1rwzLgOpkvBw4jhkSVCA1C68TkdP/c=
2022-04-12T17:50:29.272 INFO:teuthology.kill:2022-04-12 17:50:29,272.272 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-12T17:50:29.276 INFO:teuthology.kill:2022-04-12 17:50:29,276.276 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-12T17:50:29.351 INFO:teuthology.kill:2022-04-12 17:50:29,351.351 INFO:teuthology.orchestra.console:Power off smithi090
2022-04-12T17:50:29.365 INFO:teuthology.kill:2022-04-12 17:50:29,364.364 INFO:teuthology.orchestra.console:Power off smithi145
2022-04-12T17:50:37.720 INFO:teuthology.kill:2022-04-12 17:50:37,720.720 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-04-12T17:50:37.864 INFO:teuthology.kill:2022-04-12 17:50:37,863.863 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2022-04-12T17:50:41.836 INFO:teuthology.kill:2022-04-12 17:50:41,835.835 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-04-12T17:50:41.982 INFO:teuthology.kill:2022-04-12 17:50:41,982.982 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2022-04-12T17:52:42.296 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-12T17:52:42.430 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789209
2022-04-12T17:52:42.431 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789209