2022-04-02T22:41:17.052 INFO:root:teuthology version: 1.1.0-d877b023
2022-04-02T22:41:17.180 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging
2022-04-02T22:41:17.181 INFO:teuthology.lock.ops:Updating [ubuntu@smithi057.front.sepia.ceph.com]: reset os type and version on server
2022-04-02T22:41:17.182 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-04-02T22:41:17.202 INFO:teuthology.lock.ops:Node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging is complete
2022-04-02T22:41:17.203 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging
2022-04-02T22:41:17.203 INFO:teuthology.lock.ops:Updating [ubuntu@smithi176.front.sepia.ceph.com]: reset os type and version on server
2022-04-02T22:41:17.204 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-04-02T22:41:17.224 INFO:teuthology.lock.ops:Node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging is complete
2022-04-02T22:41:17.451 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.4
2022-04-02T22:41:17.487 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of rhel 8.4
2022-04-02T22:41:17.857 INFO:teuthology.orchestra.console:Power off smithi176
2022-04-02T22:41:17.880 INFO:teuthology.orchestra.console:Power off smithi057
2022-04-02T22:41:26.237 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-04-02T22:41:26.338 INFO:teuthology.orchestra.console:Power on smithi176
2022-04-02T22:41:30.354 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-04-02T22:41:30.456 INFO:teuthology.orchestra.console:Power on smithi057
2022-04-02T22:41:34.709 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2022-04-02T22:41:34.714 INFO:teuthology.orchestra.console:Power on for smithi057 completed
2022-04-02T22:41:34.811 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2022-04-02T22:41:34.816 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2022-04-02T22:46:06.725 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-02T22:46:06.777 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-02T22:46:06.973 INFO:teuthology.provision.fog.smithi057:Node is ready
2022-04-02T22:46:06.989 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2022-04-02T22:46:07.046 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2022-04-02T22:46:07.051 INFO:teuthology.provision.fog.smithi176:Node is ready
2022-04-02T22:46:07.067 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2022-04-02T22:46:07.123 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2022-04-02T22:46:07.365 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2022-04-02T22:46:07.431 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2022-04-02T22:46:07.596 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2022-04-02T22:46:07.597 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-02T22:46:07.620 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2022-04-02T22:46:07.621 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-02T22:46:07.640 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2022-04-02T22:46:07.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-04-02T22:46:07.864 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2022-04-02T22:46:07.920 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2022-04-02T22:46:07.920 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.4 (Ootpa)"
2022-04-02T22:46:07.920 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2022-04-02T22:46:07.921 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2022-04-02T22:46:07.921 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.4"
2022-04-02T22:46:07.921 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2022-04-02T22:46:07.921 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-02T22:46:07.922 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2022-04-02T22:46:07.922 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-02T22:46:07.922 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2022-04-02T22:46:07.922 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-02T22:46:07.923 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-02T22:46:07.923 INFO:teuthology.orchestra.run.smithi057.stdout:
2022-04-02T22:46:07.923 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-02T22:46:07.924 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-02T22:46:07.924 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-02T22:46:07.924 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-02T22:46:07.925 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-04-02T22:46:07.942 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2022-04-02T22:46:07.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-04-02T22:46:08.166 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2022-04-02T22:46:08.220 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Red Hat Enterprise Linux"
2022-04-02T22:46:08.220 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8.4 (Ootpa)"
2022-04-02T22:46:08.220 INFO:teuthology.orchestra.run.smithi176.stdout:ID="rhel"
2022-04-02T22:46:08.221 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="fedora"
2022-04-02T22:46:08.221 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8.4"
2022-04-02T22:46:08.221 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2022-04-02T22:46:08.221 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-02T22:46:08.221 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2022-04-02T22:46:08.222 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-02T22:46:08.222 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.redhat.com/"
2022-04-02T22:46:08.222 INFO:teuthology.orchestra.run.smithi176.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-02T22:46:08.222 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-02T22:46:08.223 INFO:teuthology.orchestra.run.smithi176.stdout:
2022-04-02T22:46:08.223 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-02T22:46:08.223 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-02T22:46:08.223 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-02T22:46:08.223 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-02T22:46:08.224 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-04-02T22:46:08.322 INFO:teuthology.dispatcher.supervisor:Running job 6774011
2022-04-02T22:46:08.323 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-02_19:34:47-fs-wip-55110-for-testing-testing-default-smithi/6774011 --name vshankar-2022-04-02_19:34:47-fs-wip-55110-for-testing-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-04-02_19:34:47-fs-wip-55110-for-testing-testing-default-smithi/6774011/orig.config.yaml
2022-04-02T22:46:08.326 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-02_19:34:47-fs-wip-55110-for-testing-testing-default-smithi/6774011
2022-04-02T22:46:08.327 INFO:teuthology.dispatcher.supervisor:Job PID: 21425
2022-04-02T22:46:08.328 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-03T05:16:37.055 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-03T05:16:37.236 INFO:teuthology.kill:Killing Pids: {21425}
2022-04-03T05:16:38.414 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-03T05:16:38.415 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-04-03T05:16:38.416 INFO:teuthology.misc:Compressing logs...
2022-04-03T05:16:38.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-04-03T05:16:38.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-04-03T05:16:39.096 INFO:teuthology.misc:Compressing logs...
2022-04-03T05:18:51.555 INFO:teuthology.misc:Compressing logs...
2022-04-03T05:22:35.936 INFO:teuthology.kill:No teuthology processes running
2022-04-03T05:22:37.021 INFO:teuthology.kill:Nuking machines: ['smithi057', 'smithi176']
2022-04-03T05:22:38.006 INFO:teuthology.kill:2022-04-03 05:22:38,005.005 INFO:teuthology.nuke:targets:
2022-04-03T05:22:38.007 INFO:teuthology.kill:  smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDuoJu/7yHUs7tJo/61z1KZPpsDD/4hs7sw9ftkqIkx4vkHS8prXZC1W7cxsede8oAZqNEPjDdQNceZZYirN3LJ1xD6IutXK9In6LdYsMiLCr+BHrbZvvCAIVbvgmg/lMuEMiGuhRpSaqUagcuBYagS49Ti9kKSMNGzamklCEOnf1Zisa6+Pclzgk6fdaEuHd9DzU6RANXU64E/yMsHxlLoe3LrIRyZBsTya6UnwUzFSVTkYPMKdA4f+jogBboq1M58i8CDPH+pijNXCul9oPcNpMXESsBOkNhWpWxSGkAXVvDPl37rd8tLLGlkhIHsizzCw3jZk/eo/srQlHPHHYEfG8XBkGM4HUUu+N410zZ97eJJ7mX6XYMZvICgRrtGcMpWnMQh2+SBOFA6Ngx2q9RggZvAbtlvzEqIbyJBQj4/9A0lRwaPK5hg5/9Bj9RUNQPn02enKCKkdOprvHUuS7MqWOf4I9xg4/WrW7acs9DEQtce9wGaQUsv3NMdIny89k=
2022-04-03T05:22:38.007 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEpy8evxMB8OMG3/2PnV8fF9Dgad0e1vkD/E/vyZBOGt/ccK08Mzv+LUDFy12eZnIQL3xvkpc9b5I0CobMN7/uBp5135KsPqK4r4sbx0GBeym6RaafNijFjV95AbIC+0Ey3/7kySVdxpV9I2dPN+n93wnYfNYS3ISdj077TTHqIyo/SyU2ljfX84x1ho0mQvewPhi2lugDWLxrjY0TdKYG4O50FnwwpxcUeGfS3FXG6jQW8Ermq17rsoteUF6tnK1KVrfhpQPa+7nRR0wG+Xay2iQkNJoNx7iJbMsejvfOBZlQro230W9s8jhOwxdPzl714dBFSsvavZnRpvU/bN23LA5Gx8T/LN097d1mruYt9WVCHH5yo7m4og0PrsZUAaBmmsFBLZHIyO9hW3/Tz9C/euE/3by6l3jAy8IKsHCyoqrKlwTofKwNiBf93lt1R5mos7gnRSBCk4OXnfRLjlf2CvzNe8Rq09VQo7T+ebdqm/5e1O/D8fgGSX+TggXTHXM=
2022-04-03T05:22:38.033 INFO:teuthology.kill:2022-04-03 05:22:38,033.033 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-03T05:22:38.036 INFO:teuthology.kill:2022-04-03 05:22:38,036.036 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-03T05:22:38.117 INFO:teuthology.kill:2022-04-03 05:22:38,117.117 INFO:teuthology.orchestra.console:Power off smithi176
2022-04-03T05:22:38.132 INFO:teuthology.kill:2022-04-03 05:22:38,131.131 INFO:teuthology.orchestra.console:Power off smithi057
2022-04-03T05:22:46.489 INFO:teuthology.kill:2022-04-03 05:22:46,488.488 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-04-03T05:22:46.643 INFO:teuthology.kill:2022-04-03 05:22:46,642.642 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2022-04-03T05:22:50.623 INFO:teuthology.kill:2022-04-03 05:22:50,623.623 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-04-03T05:22:50.772 INFO:teuthology.kill:2022-04-03 05:22:50,772.772 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2022-04-03T05:24:51.065 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-03T05:24:51.173 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi057 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-03_05:00:02-smoke-master-distro-default-smithi/6774666