2022-04-03T19:39:38.119 INFO:root:teuthology version: 1.1.0-d877b023
2022-04-03T19:39:38.241 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging
2022-04-03T19:39:38.242 INFO:teuthology.lock.ops:Updating [ubuntu@smithi084.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T19:39:38.243 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2022-04-03T19:39:38.264 INFO:teuthology.lock.ops:Node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging is complete
2022-04-03T19:39:38.265 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging
2022-04-03T19:39:38.265 INFO:teuthology.lock.ops:Updating [ubuntu@smithi174.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T19:39:38.265 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2022-04-03T19:39:38.292 INFO:teuthology.lock.ops:Node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging is complete
2022-04-03T19:39:38.487 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream
2022-04-03T19:39:38.506 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 8.stream
2022-04-03T19:39:38.780 INFO:teuthology.orchestra.console:Power off smithi084
2022-04-03T19:39:38.793 INFO:teuthology.orchestra.console:Power off smithi174
2022-04-03T19:39:47.160 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2022-04-03T19:39:47.261 INFO:teuthology.orchestra.console:Power on smithi174
2022-04-03T19:39:51.264 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2022-04-03T19:39:51.366 INFO:teuthology.orchestra.console:Power on smithi084
2022-04-03T19:39:55.727 INFO:teuthology.orchestra.console:Power on for smithi174 completed
2022-04-03T19:39:55.829 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2022-04-03T19:39:59.849 INFO:teuthology.orchestra.console:Power on for smithi084 completed
2022-04-03T19:39:59.950 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2022-04-03T19:44:24.693 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T19:44:24.932 INFO:teuthology.provision.fog.smithi174:Node is ready
2022-04-03T19:44:24.950 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2022-04-03T19:44:25.007 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2022-04-03T19:44:25.353 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2022-04-03T19:44:37.749 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T19:44:37.977 INFO:teuthology.provision.fog.smithi084:Node is ready
2022-04-03T19:44:38.034 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com
2022-04-03T19:44:38.091 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084
2022-04-03T19:44:38.424 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2022-04-03T19:44:38.568 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2022-04-03T19:44:38.569 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T19:44:38.585 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2022-04-03T19:44:38.585 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T19:44:38.603 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2022-04-03T19:44:38.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2022-04-03T19:44:38.790 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2022-04-03T19:44:38.846 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2022-04-03T19:44:38.846 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2022-04-03T19:44:38.846 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2022-04-03T19:44:38.847 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2022-04-03T19:44:38.847 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2022-04-03T19:44:38.847 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2022-04-03T19:44:38.847 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-03T19:44:38.847 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2022-04-03T19:44:38.848 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-03T19:44:38.848 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2022-04-03T19:44:38.848 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T19:44:38.848 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T19:44:38.849 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-03T19:44:38.850 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2022-04-03T19:44:38.867 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2022-04-03T19:44:38.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2022-04-03T19:44:39.109 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2022-04-03T19:44:39.166 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2022-04-03T19:44:39.166 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8"
2022-04-03T19:44:39.167 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2022-04-03T19:44:39.167 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2022-04-03T19:44:39.167 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8"
2022-04-03T19:44:39.167 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2022-04-03T19:44:39.167 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-03T19:44:39.168 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2022-04-03T19:44:39.168 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-03T19:44:39.168 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2022-04-03T19:44:39.168 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T19:44:39.169 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T19:44:39.169 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-03T19:44:39.169 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2022-04-03T19:44:39.254 INFO:teuthology.dispatcher.supervisor:Running job 6775579
2022-04-03T19:44:39.255 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775579 --name vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775579/orig.config.yaml
2022-04-03T19:44:39.258 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775579
2022-04-03T19:44:39.259 INFO:teuthology.dispatcher.supervisor:Job PID: 14351
2022-04-03T19:44:39.259 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-04T02:15:06.969 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-04T02:15:07.149 INFO:teuthology.kill:Killing Pids: {14351}
2022-04-04T02:15:08.240 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-04T02:15:08.240 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-04-04T02:15:08.241 INFO:teuthology.misc:Compressing logs...
2022-04-04T02:15:08.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2022-04-04T02:15:08.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2022-04-04T02:15:08.906 INFO:teuthology.misc:Compressing logs...
2022-04-04T02:16:43.880 INFO:teuthology.misc:Compressing logs...
2022-04-04T02:18:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:tar: .: file changed as we read it
2022-04-04T02:18:57.503 INFO:teuthology.kill:No teuthology processes running
2022-04-04T02:18:58.585 INFO:teuthology.kill:Nuking machines: ['smithi084', 'smithi174']
2022-04-04T02:18:59.452 INFO:teuthology.kill:2022-04-04 02:18:59,451.451 INFO:teuthology.nuke:targets:
2022-04-04T02:18:59.453 INFO:teuthology.kill:  smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEkno+FZ/6C0wp2iXnG0BPPObIeMICA3DMk2TK+1OPyTwWl6cXZhNVjcUgabEdt0x5zqsfvPY53fC5/HUCO5rbyHhH8+QZ3RLdEzkMIohfvgRtfsioAta9jGYRX0E5M8RZvVu5vuLfzVA/omojDaBeOFFUVXKIlywILQ0tYbhL+15gUMatGs7i+y235d+94laAzwnClKWFsoacdBGpRrpY7XExBY4f4nMV5tJucoNHmIApnRu4lbTWnRwauAqwJN22Vg/vXVWy0PwYo3yMGKo1KfkYMkQB+jO+k94lk2YP0wZbJKPk1CvzbxCaiwRNqnM9A3lPYwzrA31Mvk7rEMOGoN3E4BYGcbf1a4yZUnCVOI4Dw5TUiWa+SapSN1eM3lLT0FL4oe1ua4EsfaoyLfDIQMD8cpL8KRhbq3ag3qlS63YkGz9dLtsfpdabqwvk3VQWxIUwfW9MPh+QZA0m9l0KMii3bEi6RFNNanDYqryBel+4GUP0gyiHfeHs0kSQec=
2022-04-04T02:18:59.453 INFO:teuthology.kill:  smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUG9cOHyf/jsW3Oe66a7lq0DKQhiUZtAYfs+aCHTXI8qncUgP27kP1oJmENgxbp3HfyY/p7uIeFiNV8gjCw/oUE2XyIogl1z4ACmU86Pf5DFIYP3zUN50gSKOFYsG9r9rwx6r+8Ey9n7GNf8Z12GqhjGcPcdlkWvI7vNyxSG+Eby16DvapamvJtAcS4gA8oED9be/NB1NdBrEy6/J/J/9NpVhRIx5yYECCdf3Q/+nz57QD0yRnSlgciDY8kzSy1EZPzg311COan7n7dbE7hoqSxwXS8kA8nMAXuyLGVsEkRpAyjmMTapprA6+aLO+TZfrW8gJUWh/ebEFyfxzOAQSOysE4xha74fCpylrynmpoht+oqvP4fBbYSP/n8GScrWAi80KSg8ZBTfl/K3mvRh2JPCarMfdEWcz1fOkZejzwwhgdMGOqpLsuo3cmM8NfOH6OZ79a7C/jPR/YRnlacUw9llLR49vTQ/oF7AycB+/SFlrxHGSXhK1n98yv+yOnYW8=
2022-04-04T02:18:59.477 INFO:teuthology.kill:2022-04-04 02:18:59,477.477 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-04T02:18:59.489 INFO:teuthology.kill:2022-04-04 02:18:59,489.489 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-04T02:18:59.543 INFO:teuthology.kill:2022-04-04 02:18:59,542.542 INFO:teuthology.orchestra.console:Power off smithi174
2022-04-04T02:18:59.557 INFO:teuthology.kill:2022-04-04 02:18:59,557.557 INFO:teuthology.orchestra.console:Power off smithi084
2022-04-04T02:19:07.908 INFO:teuthology.kill:2022-04-04 02:19:07,907.907 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2022-04-04T02:19:07.914 INFO:teuthology.kill:2022-04-04 02:19:07,914.914 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2022-04-04T02:19:08.052 INFO:teuthology.kill:2022-04-04 02:19:08,051.051 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com
2022-04-04T02:19:08.055 INFO:teuthology.kill:2022-04-04 02:19:08,055.055 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com
2022-04-04T02:21:08.352 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-04T02:21:08.460 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi084 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-01_01:50:02-upgrade:client-upgrade-mimic-octopus-octopus-distro-default-smithi/6771408
2022-04-04T02:21:08.460 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi174 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-01_01:50:02-upgrade:client-upgrade-mimic-octopus-octopus-distro-default-smithi/6771408