2022-04-03T17:49:49.956 INFO:root:teuthology version: 1.1.0-d877b023
2022-04-03T17:49:50.085 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging
2022-04-03T17:49:50.086 INFO:teuthology.lock.ops:Updating [ubuntu@smithi059.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T17:49:50.087 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-04-03T17:49:50.110 INFO:teuthology.lock.ops:Node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging is complete
2022-04-03T17:49:50.110 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging
2022-04-03T17:49:50.110 INFO:teuthology.lock.ops:Updating [ubuntu@smithi073.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T17:49:50.111 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-03T17:49:50.130 INFO:teuthology.lock.ops:Node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging is complete
2022-04-03T17:49:50.318 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.4
2022-04-03T17:49:50.339 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4
2022-04-03T17:49:50.666 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-03T17:49:50.682 INFO:teuthology.orchestra.console:Power off smithi059
2022-04-03T17:49:50.814 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-03T17:49:50.821 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-04-03T17:49:50.915 INFO:teuthology.orchestra.console:Power on smithi073
2022-04-03T17:49:50.924 INFO:teuthology.orchestra.console:Power on smithi059
2022-04-03T17:49:55.173 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2022-04-03T17:49:55.274 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2022-04-03T17:49:59.297 INFO:teuthology.orchestra.console:Power on for smithi059 completed
2022-04-03T17:49:59.398 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2022-04-03T17:54:13.444 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T17:54:13.705 INFO:teuthology.provision.fog.smithi059:Node is ready
2022-04-03T17:54:13.721 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2022-04-03T17:54:13.777 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2022-04-03T17:54:14.114 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2022-04-03T17:54:33.331 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T17:54:33.570 INFO:teuthology.provision.fog.smithi073:Node is ready
2022-04-03T17:54:33.641 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2022-04-03T17:54:33.726 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2022-04-03T17:54:34.191 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2022-04-03T17:54:34.491 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2022-04-03T17:54:34.492 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T17:54:34.521 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2022-04-03T17:54:34.523 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T17:54:34.544 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2022-04-03T17:54:34.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-04-03T17:54:34.788 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2022-04-03T17:54:34.843 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux"
2022-04-03T17:54:34.844 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.4 (Ootpa)"
2022-04-03T17:54:34.844 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel"
2022-04-03T17:54:34.844 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora"
2022-04-03T17:54:34.844 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.4"
2022-04-03T17:54:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2022-04-03T17:54:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-03T17:54:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2022-04-03T17:54:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-03T17:54:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/"
2022-04-03T17:54:34.846 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-03T17:54:34.846 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T17:54:34.846 INFO:teuthology.orchestra.run.smithi059.stdout:
2022-04-03T17:54:34.846 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T17:54:34.847 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-03T17:54:34.847 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-03T17:54:34.847 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-03T17:54:34.848 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-04-03T17:54:34.875 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2022-04-03T17:54:34.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-03T17:54:35.104 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2022-04-03T17:54:35.159 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2022-04-03T17:54:35.160 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2022-04-03T17:54:35.160 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2022-04-03T17:54:35.161 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2022-04-03T17:54:35.161 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2022-04-03T17:54:35.161 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2022-04-03T17:54:35.162 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-03T17:54:35.162 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2022-04-03T17:54:35.163 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-03T17:54:35.163 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2022-04-03T17:54:35.164 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-03T17:54:35.164 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T17:54:35.164 INFO:teuthology.orchestra.run.smithi073.stdout:
2022-04-03T17:54:35.165 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T17:54:35.165 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-03T17:54:35.166 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-03T17:54:35.166 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-03T17:54:35.167 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-03T17:54:35.311 INFO:teuthology.dispatcher.supervisor:Running job 6775485
2022-04-03T17:54:35.311 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775485 --name vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775485/orig.config.yaml
2022-04-03T17:54:35.315 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775485
2022-04-03T17:54:35.316 INFO:teuthology.dispatcher.supervisor:Job PID: 27219
2022-04-03T17:54:35.316 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-04T00:25:03.870 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-04T00:25:04.040 INFO:teuthology.kill:Killing Pids: {27219}
2022-04-04T00:25:05.232 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-04T00:25:05.232 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']
2022-04-04T00:25:05.233 INFO:teuthology.misc:Compressing logs...
2022-04-04T00:25:05.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-04-04T00:25:05.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-04T00:25:06.167 INFO:teuthology.misc:Compressing logs...
2022-04-04T00:27:13.710 INFO:teuthology.misc:Compressing logs...
2022-04-04T00:30:26.581 INFO:teuthology.kill:No teuthology processes running
2022-04-04T00:30:27.709 INFO:teuthology.kill:Nuking machines: ['smithi059', 'smithi073']
2022-04-04T00:30:28.629 INFO:teuthology.kill:2022-04-04 00:30:28,628.628 INFO:teuthology.nuke:targets:
2022-04-04T00:30:28.629 INFO:teuthology.kill:  smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1KcqnTY6lEArOguFACYacpUVzJ1VFghsoH5g71tcO6aizjHFxhmioG3M9N431go3e+8VeC5xBJ7Axuj5126rDUbM3oVBAXcdMuipyJHQ+yMAO0Hna4hD0Ow4buT8fR3iBETcwssho5hAdGL9xuFXSAWCp/3QpiOLGMxHh2aDoQ8M7ls1Jrjs6n90kCYril3poRzDV5AY0eJTCW/LWoEde9rBWdjzU0w8dmkpvVMfkFyYPV/G5EsmIWoP4GYZjCPMUjw2PZhJYSj+kPHas0OBfd8/rtCMjsoW7dP/pCLgYUCtP/xXa54LUBRvuMgc46/cylfCszxHTgeCy6AJleBPjE7TM6+9vDOpa4CBYlNAD0pwIgnFDlSw/xKYxkewiNVqfV7eCqMPGKa4ahe+YjxP4zbqmcatIjr8xqNrsiXkD6jL02lPtz5+P/ia+Qkpg8d/ZAKipBExNtDnSocvUPXPMSaKjLhBq/3MWz5cYxEdlDuvxkjMBn1QfZVvsjx481KE=
2022-04-04T00:30:28.630 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2xOujibLE+de4Xr2ovD8poLDkCUFekiUzq5xuprTeTVLZmUND8LznKkgcEnVp9vbTOWdvq6QMmJLmzTJKoJ/SMn1PoK6Qfk15lOI5NNzvJk30/BqR7Nu2s1L8gJNIjzC99ENkVEFuBvyzkLovlmllUImfLYtS3tQEof7R7qTvD5mmtGRfJigWpJSMlhd8+iVm5h7+Tihhdm0dS8iCeuUzW2bzqujc3zwzw5zOgBP3v7xXDaLi/4JDWAvmoTV9zPv5Mu940JdG4lOag/ZrK7Zh+1hn6lKD/awcNPlndLOF8IAmJkyW2VQSuUreev8+GCSDKbXd/xrLjPa8u1Oi8rhjGmvkN4/SmpHrbKdoaofCT1nVqZR6hmZORnZuouZuKFp/eoybhH3aObXQN8XFxEWCiLaNUFoBHxUAYGk16yCjKgpRtwy/4wQUIuc2L8YUW2nwJ2mwDqI7MGFM3EcCC0IdcQPeOsEVsVM/Kr0q7vlcpAB85NFu3i3PTqzdsaCeyM=
2022-04-04T00:30:28.654 INFO:teuthology.kill:2022-04-04 00:30:28,654.654 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-04T00:30:28.657 INFO:teuthology.kill:2022-04-04 00:30:28,657.657 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-04T00:30:28.730 INFO:teuthology.kill:2022-04-04 00:30:28,730.730 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-04T00:30:28.744 INFO:teuthology.kill:2022-04-04 00:30:28,743.743 INFO:teuthology.orchestra.console:Power off smithi059
2022-04-04T00:30:37.105 INFO:teuthology.kill:2022-04-04 00:30:37,105.105 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-04-04T00:30:37.256 INFO:teuthology.kill:2022-04-04 00:30:37,256.256 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com
2022-04-04T00:30:41.213 INFO:teuthology.kill:2022-04-04 00:30:41,212.212 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-04T00:30:41.357 INFO:teuthology.kill:2022-04-04 00:30:41,357.357 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2022-04-04T00:32:41.662 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-04T00:32:41.777 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-31_06:00:02-rbd-octopus-distro-default-smithi/6769614
2022-04-04T00:32:41.777 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-31_06:00:02-rbd-octopus-distro-default-smithi/6769615