2023-03-04T12:44:07.700 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05
2023-03-04T12:44:07.841 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2023-03-04T12:44:07.842 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2023-03-04T12:44:07.842 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-03-04T12:44:07.872 INFO:teuthology.lock.ops:Node 'smithi131.front.sepia.ceph.com' reimaging is complete
2023-03-04T12:44:07.872 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging
2023-03-04T12:44:07.873 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server
2023-03-04T12:44:07.874 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server
2023-03-04T12:44:07.903 INFO:teuthology.lock.ops:Node 'smithi182.front.sepia.ceph.com' reimaging is complete
2023-03-04T12:44:08.051 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of rhel 8.6
2023-03-04T12:44:08.054 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of rhel 8.6
2023-03-04T12:44:08.287 INFO:teuthology.orchestra.console:Power off smithi182
2023-03-04T12:44:08.306 INFO:teuthology.orchestra.console:Power off smithi131
2023-03-04T12:44:08.445 INFO:teuthology.orchestra.console:Power off for smithi182 completed
2023-03-04T12:44:08.546 INFO:teuthology.orchestra.console:Power on smithi182
2023-03-04T12:44:12.805 INFO:teuthology.orchestra.console:Power on for smithi182 completed
2023-03-04T12:44:12.907 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish
2023-03-04T12:44:20.796 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-03-04T12:44:20.897 INFO:teuthology.orchestra.console:Power on smithi131
2023-03-04T12:44:25.155 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2023-03-04T12:44:25.256 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2023-03-04T12:47:01.701 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:10.761 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:14.117 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-03-04T12:47:19.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:23.173 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-03-04T12:47:28.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:32.265 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-03-04T12:47:37.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:41.317 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-03-04T12:47:47.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:47:50.373 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-03-04T12:47:59.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:48:08.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:48:17.221 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-03-04T12:48:25.543 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-04T12:48:25.886 INFO:teuthology.provision.fog.smithi182:Node is ready
2023-03-04T12:48:25.905 INFO:teuthology.orchestra.run.smithi182.stdout:smithi022
2023-03-04T12:48:25.961 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-03-04T12:48:26.297 INFO:teuthology.provision.fog.smithi182:Deploy complete!
2023-03-04T12:48:56.409 WARNING:teuthology.provision.fog:timed out
2023-03-04T12:49:02.737 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-04T12:49:03.022 INFO:teuthology.provision.fog.smithi131:Node is ready
2023-03-04T12:49:03.040 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2023-03-04T12:49:03.098 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2023-03-04T12:49:03.454 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2023-03-04T12:49:03.651 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2023-03-04T12:49:03.652 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-04T12:49:03.675 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com
2023-03-04T12:49:03.677 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2023-03-04T12:49:03.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-03-04T12:49:03.870 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux"
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)"
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel"
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora"
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6"
2023-03-04T12:49:03.926 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-04T12:49:03.927 INFO:teuthology.orchestra.run.smithi131.stdout:
2023-03-04T12:49:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-04T12:49:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-04T12:49:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-04T12:49:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-04T12:49:03.929 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-03-04T12:49:03.950 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server
2023-03-04T12:49:03.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com'
2023-03-04T12:49:04.203 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64
2023-03-04T12:49:04.260 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Red Hat Enterprise Linux"
2023-03-04T12:49:04.260 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8.6 (Ootpa)"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:ID="rhel"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="fedora"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8.6"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31"
2023-03-04T12:49:04.261 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.redhat.com/"
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-04T12:49:04.262 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-04T12:49:04.263 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-04T12:49:04.263 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server
2023-03-04T12:49:04.365 INFO:teuthology.dispatcher.supervisor:Running job 7193882
2023-03-04T12:49:04.365 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-03-03_21:39:49-fs-wip-rishabh-2023Mar03-2316-testing-default-smithi/7193882 --name rishabh-2023-03-03_21:39:49-fs-wip-rishabh-2023Mar03-2316-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2023-03-03_21:39:49-fs-wip-rishabh-2023Mar03-2316-testing-default-smithi/7193882/orig.config.yaml
2023-03-04T12:49:04.369 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-03-03_21:39:49-fs-wip-rishabh-2023Mar03-2316-testing-default-smithi/7193882
2023-03-04T12:49:04.370 INFO:teuthology.dispatcher.supervisor:Job PID: 980
2023-03-04T12:49:04.370 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-05T00:49:58.825 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-05T00:49:58.989 INFO:teuthology.kill:Killing Pids: {980}
2023-03-05T00:49:59.756 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-03-05T00:49:59.757 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-03-05T00:49:59.757 INFO:teuthology.misc:Compressing logs...
2023-03-05T00:49:59.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-03-05T00:50:00.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com'
2023-03-05T00:50:00.617 INFO:teuthology.misc:Compressing logs...
2023-03-05T00:50:01.019 INFO:teuthology.orchestra.run.smithi182.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-05T00:50:01.253 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-05T00:50:01.645 INFO:teuthology.misc:Compressing logs...
2023-03-05T00:57:51.237 INFO:teuthology.kill:No teuthology processes running
2023-03-05T00:57:51.907 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi182']
2023-03-05T00:57:52.437 INFO:teuthology.kill:2023-03-05 00:57:52,436.436 INFO:teuthology.nuke:targets:
2023-03-05T00:57:52.438 INFO:teuthology.kill:  smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-05T00:57:52.438 INFO:teuthology.kill:  smithi182.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=
2023-03-05T00:57:52.438 INFO:teuthology.kill:2023-03-05 00:57:52,436.436 INFO:teuthology.nuke:Checking targets against current locks
2023-03-05T00:57:52.494 INFO:teuthology.kill:2023-03-05 00:57:52,494.494 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-05T00:57:52.525 INFO:teuthology.kill:2023-03-05 00:57:52,524.524 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-05T00:57:52.567 INFO:teuthology.kill:2023-03-05 00:57:52,566.566 INFO:teuthology.orchestra.console:Power off smithi131
2023-03-05T00:57:52.606 INFO:teuthology.kill:2023-03-05 00:57:52,606.606 INFO:teuthology.orchestra.console:Power off smithi182
2023-03-05T00:58:05.056 INFO:teuthology.kill:2023-03-05 00:58:05,055.055 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-03-05T00:58:05.074 INFO:teuthology.kill:2023-03-05 00:58:05,073.073 INFO:teuthology.orchestra.console:Power off for smithi182 completed
2023-03-05T00:58:05.233 INFO:teuthology.kill:2023-03-05 00:58:05,232.232 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com
2023-03-05T00:58:05.234 INFO:teuthology.kill:2023-03-05 00:58:05,234.234 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2023-03-05T01:00:05.489 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15