2022-03-18T13:28:48.365 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T13:28:48.484 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging
2022-03-18T13:28:48.485 INFO:teuthology.lock.ops:Updating [ubuntu@smithi045.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T13:28:48.486 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-03-18T13:28:48.503 INFO:teuthology.lock.ops:Node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging is complete
2022-03-18T13:28:48.503 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging
2022-03-18T13:28:48.504 INFO:teuthology.lock.ops:Updating [ubuntu@smithi171.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T13:28:48.504 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2022-03-18T13:28:48.521 INFO:teuthology.lock.ops:Node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging is complete
2022-03-18T13:28:48.717 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.4
2022-03-18T13:28:48.727 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of rhel 8.4
2022-03-18T13:28:49.041 INFO:teuthology.orchestra.console:Power off smithi045
2022-03-18T13:28:49.080 INFO:teuthology.orchestra.console:Power off smithi171
2022-03-18T13:28:57.415 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-03-18T13:28:57.438 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2022-03-18T13:28:57.517 INFO:teuthology.orchestra.console:Power on smithi045
2022-03-18T13:28:57.547 INFO:teuthology.orchestra.console:Power on smithi171
2022-03-18T13:29:05.934 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2022-03-18T13:29:05.958 INFO:teuthology.orchestra.console:Power on for smithi171 completed
2022-03-18T13:29:06.036 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2022-03-18T13:29:06.059 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2022-03-18T13:33:27.340 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T13:33:34.680 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T13:33:34.906 INFO:teuthology.provision.fog.smithi045:Node is ready
2022-03-18T13:33:34.921 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2022-03-18T13:33:34.976 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2022-03-18T13:33:35.319 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2022-03-18T13:33:47.301 INFO:teuthology.provision.fog.smithi171:Node is ready
2022-03-18T13:33:47.320 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2022-03-18T13:33:47.378 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2022-03-18T13:33:47.722 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2022-03-18T13:33:47.895 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2022-03-18T13:33:47.896 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T13:33:47.918 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2022-03-18T13:33:47.918 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T13:33:47.936 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2022-03-18T13:33:47.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-03-18T13:33:48.174 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2022-03-18T13:33:48.230 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2022-03-18T13:33:48.230 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.4 (Ootpa)"
2022-03-18T13:33:48.230 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2022-03-18T13:33:48.230 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2022-03-18T13:33:48.231 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.4"
2022-03-18T13:33:48.231 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2022-03-18T13:33:48.231 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-18T13:33:48.232 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2022-03-18T13:33:48.232 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-18T13:33:48.232 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2022-03-18T13:33:48.232 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-18T13:33:48.233 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T13:33:48.233 INFO:teuthology.orchestra.run.smithi045.stdout:
2022-03-18T13:33:48.233 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T13:33:48.233 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-18T13:33:48.234 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-18T13:33:48.234 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-18T13:33:48.235 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-03-18T13:33:48.256 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2022-03-18T13:33:48.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2022-03-18T13:33:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2022-03-18T13:33:48.545 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux"
2022-03-18T13:33:48.546 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.4 (Ootpa)"
2022-03-18T13:33:48.546 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel"
2022-03-18T13:33:48.546 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora"
2022-03-18T13:33:48.546 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.4"
2022-03-18T13:33:48.546 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2022-03-18T13:33:48.547 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-18T13:33:48.547 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2022-03-18T13:33:48.547 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-18T13:33:48.547 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/"
2022-03-18T13:33:48.548 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-18T13:33:48.548 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T13:33:48.548 INFO:teuthology.orchestra.run.smithi171.stdout:
2022-03-18T13:33:48.548 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T13:33:48.549 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-18T13:33:48.549 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-18T13:33:48.549 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-18T13:33:48.549 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2022-03-18T13:33:48.660 INFO:teuthology.dispatcher.supervisor:Running job 6744673
2022-03-18T13:33:48.661 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744673 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744673/orig.config.yaml
2022-03-18T13:33:48.664 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744673
2022-03-18T13:33:48.665 INFO:teuthology.dispatcher.supervisor:Job PID: 22980
2022-03-18T13:33:48.665 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-18T20:04:16.851 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-18T20:04:17.012 INFO:teuthology.kill:Killing Pids: {22980}
2022-03-18T20:04:18.326 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-18T20:04:18.327 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-18T20:04:18.328 INFO:teuthology.misc:Compressing logs...
2022-03-18T20:04:18.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-03-18T20:04:18.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2022-03-18T20:04:18.904 INFO:teuthology.misc:Compressing logs...
2022-03-18T20:04:19.028 INFO:teuthology.misc:Compressing logs...
2022-03-18T20:06:18.254 INFO:teuthology.kill:No teuthology processes running
2022-03-18T20:06:19.465 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi171']
2022-03-18T20:06:20.531 INFO:teuthology.kill:2022-03-18 20:06:20,530.530 INFO:teuthology.nuke:targets:
2022-03-18T20:06:20.531 INFO:teuthology.kill:  smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCypw0aq5Xs5kCz4+RGz+6Nz+fUyU37H2p0OqriO56+YB7CNiKAT+Vh3FQQvjzZl2+BstuRRPntFh+159T8wpxZ42ovLGZBsfaz4EF80+EAf5r9jmy9Q7PBf4KvdnzpWLRMPp/z5UdQZtwWQujOPjcpo0fqBlTjC4NRmpG16C7TUsUMK6JLXRZDEwNVJZtvUXRKbEtYfpw4eKhE8s0srVKXmYxyUhxqvX055yXafuALI4kIcJdAhNmbbCsgKB8K6JnJssRrfbkTtqrZpYW9LDQqdBTieoaka5MbLXk/YZi0jcqbScakPXN2g3jzAoh96eRVz7fmTBgxfSgCzryLHWfvC/mYNVVRrs/JzVEpLHv/OqaOCEKMqtqTlV5LLqeFlxi6Dhn4a7Z5clsHKJ+6/YYGc+A0jOvZaugMBe0bWx1Fskvg+LBC5EJYiKMbQKraPN5nkhCMjbVZtOtW+q7QocA88nc9ggt5JNK1bnYwsmy341M6QQQk+jGfRexV2TtHm2M=
2022-03-18T20:06:20.532 INFO:teuthology.kill:  smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHVV8IwUTRU9QbT9EmBrnJaM2DQBebCkxCcCDSVnKnR8qEOFVrhdS9iCIr7Zv7k86MQKpPDWZuZuZrMLR9LUCW2DkqbNOUZ/cEsPQX/OZySUSX1yNeCSlH5L3MR/1o2p13GvUyq8U+CUaekCK73/SUR9kcKzlV28ImMGYSNFYLhjD+QTCte8SWxpfUbrZracK9yk5BXV/vACQLu3XK1eT+8TGdY7FTQ3FPiDWZvRpilQv4VurHyCCxgHAzSYPsA0I+iRCy/wPuN9Dw3MadsDkefK6L8gTV9xTNxCDGRJI1Hkd5lFQK0teUHrhUIc+DA3d3vKjQkRWzIrMvAWPmV6Dp54cT0b6zKffftn8h+nDTgvfdBFpMLe8PIpEKcvmT9t/TfwCREnKtDLLSUC15EsUmsa7bsqBKYY9mg4G1D4g1xqf0GJM/YLuHdDnc+CV3P7jc8ZT3ljzzKt8v6S4C2wMMc/loWyWfZdT3BvhCajVO4cFK3jmhVk/o68emEdQNfjU=
2022-03-18T20:06:20.558 INFO:teuthology.kill:2022-03-18 20:06:20,558.558 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T20:06:20.567 INFO:teuthology.kill:2022-03-18 20:06:20,567.567 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T20:06:20.631 INFO:teuthology.kill:2022-03-18 20:06:20,631.631 INFO:teuthology.orchestra.console:Power off smithi045
2022-03-18T20:06:20.648 INFO:teuthology.kill:2022-03-18 20:06:20,648.648 INFO:teuthology.orchestra.console:Power off smithi171
2022-03-18T20:06:33.128 INFO:teuthology.kill:2022-03-18 20:06:33,127.127 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-03-18T20:06:33.133 INFO:teuthology.kill:2022-03-18 20:06:33,133.133 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2022-03-18T20:06:33.280 INFO:teuthology.kill:2022-03-18 20:06:33,279.279 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com
2022-03-18T20:06:33.283 INFO:teuthology.kill:2022-03-18 20:06:33,282.282 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2022-03-18T20:08:33.617 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-18T20:08:33.750 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-18_14:52:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6745350
2022-03-18T20:08:33.750 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi171 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-18_14:52:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6745350