2022-03-20T07:22:55.891 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-20T07:22:56.017 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging
2022-03-20T07:22:56.018 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T07:22:56.019 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2022-03-20T07:22:56.039 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete
2022-03-20T07:22:56.039 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi103.front.sepia.ceph.com' reimaging
2022-03-20T07:22:56.040 INFO:teuthology.lock.ops:Updating [ubuntu@smithi103.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T07:22:56.040 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-03-20T07:22:56.058 INFO:teuthology.lock.ops:Node 'ubuntu@smithi103.front.sepia.ceph.com' reimaging is complete
2022-03-20T07:22:56.244 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream
2022-03-20T07:22:56.269 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream
2022-03-20T07:22:56.571 INFO:teuthology.orchestra.console:Power off smithi049
2022-03-20T07:22:56.620 INFO:teuthology.orchestra.console:Power off smithi103
2022-03-20T07:23:04.953 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2022-03-20T07:23:05.054 INFO:teuthology.orchestra.console:Power on smithi049
2022-03-20T07:23:09.092 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-03-20T07:23:09.193 INFO:teuthology.orchestra.console:Power on smithi103
2022-03-20T07:23:13.417 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2022-03-20T07:23:13.518 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2022-03-20T07:23:17.557 INFO:teuthology.orchestra.console:Power on for smithi103 completed
2022-03-20T07:23:17.658 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2022-03-20T07:27:47.991 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T07:28:13.581 INFO:teuthology.provision.fog.smithi103:Node is ready
2022-03-20T07:28:13.603 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2022-03-20T07:28:13.662 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2022-03-20T07:28:14.027 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2022-03-20T07:28:33.418 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T07:28:33.663 INFO:teuthology.provision.fog.smithi049:Node is ready
2022-03-20T07:28:33.722 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2022-03-20T07:28:33.783 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2022-03-20T07:28:34.138 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2022-03-20T07:28:34.284 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2022-03-20T07:28:34.285 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T07:28:34.304 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2022-03-20T07:28:34.304 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T07:28:34.321 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2022-03-20T07:28:34.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2022-03-20T07:28:34.516 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2022-03-20T07:28:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2022-03-20T07:28:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2022-03-20T07:28:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2022-03-20T07:28:34.573 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2022-03-20T07:28:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2022-03-20T07:28:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2022-03-20T07:28:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-20T07:28:34.574 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2022-03-20T07:28:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-20T07:28:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2022-03-20T07:28:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T07:28:34.575 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T07:28:34.576 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-20T07:28:34.577 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2022-03-20T07:28:34.594 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2022-03-20T07:28:34.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-03-20T07:28:34.837 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2022-03-20T07:28:34.894 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2022-03-20T07:28:34.895 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8"
2022-03-20T07:28:34.895 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2022-03-20T07:28:34.895 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2022-03-20T07:28:34.895 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8"
2022-03-20T07:28:34.896 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2022-03-20T07:28:34.896 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-20T07:28:34.896 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2022-03-20T07:28:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-20T07:28:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2022-03-20T07:28:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T07:28:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T07:28:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-20T07:28:34.898 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-03-20T07:28:34.992 INFO:teuthology.dispatcher.supervisor:Running job 6747654
2022-03-20T07:28:34.992 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747654 --name vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747654/orig.config.yaml
2022-03-20T07:28:34.995 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747654
2022-03-20T07:28:34.996 INFO:teuthology.dispatcher.supervisor:Job PID: 29356
2022-03-20T07:28:34.996 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-20T13:59:02.756 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-20T13:59:03.165 INFO:teuthology.kill:Killing Pids: {29356}
2022-03-20T13:59:04.343 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-20T13:59:04.344 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-20T13:59:04.345 INFO:teuthology.misc:Compressing logs...
2022-03-20T13:59:04.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2022-03-20T13:59:04.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-03-20T13:59:06.952 INFO:teuthology.misc:Compressing logs...
2022-03-20T13:59:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-20T13:59:10.232 INFO:teuthology.misc:Compressing logs...
2022-03-20T14:51:41.484 INFO:teuthology.kill:No teuthology processes running
2022-03-20T14:51:42.711 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi103']
2022-03-20T14:51:43.685 INFO:teuthology.kill:2022-03-20 14:51:43,685.685 INFO:teuthology.nuke:targets:
2022-03-20T14:51:43.686 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnM5XJqBjRy9Qpc0m52XwFbdYli9zftV+v8NG3ut6g8/fB9xHRD9wn8Q04wbqFckHLk88irW1VGvNzKZBJmmFMyhRJp8I8KWnWFuBzh6EyYotHzgHLxCcDQU56TVgPjvOy/d/Ofl+FI9p0kywUHFyrNckwUp1qF90rAJPDPTNVZFfne3nfwYirAWNwqth+9p/3HSSygP/MTEpbZaTJGeB/YOSMn7js+o6eo5nhczGa0A7VQCZzqsheO83Qgda8JzRaFpoFt0bHVmIINR7RZKxsMa6aOkvjwR8VdPebxDn2nBUBfzQ2QRvzkwJW1VXH5MGGqMg/HRQkVOeviLG5fl1tk7/6kpx3D+zPked9AJ/mpCnUrRjp8pTx18jzyqXT0kSeqNcWiz7UkTffcw+gvxkN4V9CIrLC10GYIi/P6jsvvVoxocYFAnRu0s/18YWNxLsYhgxRLHySOaL7D6w3phhcn8aAtfizMmG1Ji5a0Eq2OKMlpbcxIvT7cmRpMmkTqDE=
2022-03-20T14:51:43.686 INFO:teuthology.kill:  smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZoGXZ0H9E1B6WUhkeAfs+b69QRNxy4c7jogrRAwomaMncK8mj7T62q/vEdf44mFe4s4Ubo06b1bTG6gqq+Dg9d4qNxPQtWmY48lOnvmFhVM72ae9I++54rHp53nsku4F5iuPfOLnRW4GJtncFdQMCuYI4laxfY2eZTbOmBobFS8VKiJLYrvNlT1NPu806kRSi+WsmkS1VkfkJmbDJVxS2aD7rGoAe4lg+6iBfMeMuPB4vcUeq4vVhbVlAhBwDANpA17QAoxHR4kOVi7Fpu+OGw6PPM4ng9ckWkvymreE0XqiAo66k+eEWlf5NMHMeh+c4MoAZKhLzB/nNrBx9tn7zm2VVTnYLqKjciccUt3ZwjwabIeXYri4UWV+Pcz/ALDYgLHxzlXbmdTty8O9ImorpIZuCbriBI4sAiXbcvB1MBhYuDO7pMwl6uaWpaDohvZNO0TeJJFHZka8oiWWGghOQVl+M+vDFIY9qNLssxZFTBqH9v4/1HjLxlJcdI/1d590=
2022-03-20T14:51:43.712 INFO:teuthology.kill:2022-03-20 14:51:43,712.712 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T14:51:43.715 INFO:teuthology.kill:2022-03-20 14:51:43,715.715 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T14:51:43.812 INFO:teuthology.kill:2022-03-20 14:51:43,812.812 INFO:teuthology.orchestra.console:Power off smithi049
2022-03-20T14:51:43.830 INFO:teuthology.kill:2022-03-20 14:51:43,830.830 INFO:teuthology.orchestra.console:Power off smithi103
2022-03-20T14:51:52.276 INFO:teuthology.kill:2022-03-20 14:51:52,275.275 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2022-03-20T14:51:52.421 INFO:teuthology.kill:2022-03-20 14:51:52,420.420 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2022-03-20T14:51:56.380 INFO:teuthology.kill:2022-03-20 14:51:56,379.379 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-03-20T14:51:56.528 INFO:teuthology.kill:2022-03-20 14:51:56,527.527 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2022-03-20T14:53:56.787 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-20T14:53:56.903 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:28:38-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6748901
2022-03-20T14:53:56.903 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:28:38-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6748901