2022-12-12T06:30:52.024 INFO:root:teuthology version: 0.0.1.dev18+g19d18db
2022-12-12T06:30:52.162 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2022-12-12T06:30:52.163 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2022-12-12T06:30:52.163 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-12-12T06:30:52.185 INFO:teuthology.lock.ops:Node 'smithi099.front.sepia.ceph.com' reimaging is complete
2022-12-12T06:30:52.185 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2022-12-12T06:30:52.186 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2022-12-12T06:30:52.186 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-12-12T06:30:52.205 INFO:teuthology.lock.ops:Node 'smithi170.front.sepia.ceph.com' reimaging is complete
2022-12-12T06:30:52.392 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2022-12-12T06:30:52.408 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream
2022-12-12T06:30:52.842 INFO:teuthology.orchestra.console:Power off smithi170
2022-12-12T06:30:52.859 INFO:teuthology.orchestra.console:Power off smithi099
2022-12-12T06:30:52.994 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-12-12T06:30:53.004 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-12-12T06:30:53.095 INFO:teuthology.orchestra.console:Power on smithi170
2022-12-12T06:30:53.105 INFO:teuthology.orchestra.console:Power on smithi099
2022-12-12T06:30:57.362 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2022-12-12T06:30:57.463 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2022-12-12T06:31:01.470 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2022-12-12T06:31:01.571 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2022-12-12T06:34:23.936 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.170
2022-12-12T06:34:33.027 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.170
2022-12-12T06:34:42.079 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.170
2022-12-12T06:34:51.141 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.170
2022-12-12T06:35:31.786 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: Authentication timeout.
2022-12-12T06:35:57.144 WARNING:teuthology.provision.fog:timed out
2022-12-12T06:36:03.388 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-12-12T06:36:03.653 INFO:teuthology.provision.fog.smithi170:Node is ready
2022-12-12T06:36:03.671 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2022-12-12T06:36:03.735 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2022-12-12T06:36:04.089 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2022-12-12T06:36:12.991 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-12-12T06:36:32.807 WARNING:teuthology.provision.fog:timed out
2022-12-12T06:36:39.116 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-12-12T06:36:39.407 INFO:teuthology.provision.fog.smithi099:Node is ready
2022-12-12T06:36:39.425 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2022-12-12T06:36:39.484 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2022-12-12T06:36:39.849 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2022-12-12T06:36:40.040 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2022-12-12T06:36:40.040 INFO:teuthology.lock.ops:New key found. Updating...
2022-12-12T06:36:40.061 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2022-12-12T06:36:40.061 INFO:teuthology.lock.ops:New key found. Updating...
2022-12-12T06:36:40.081 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2022-12-12T06:36:40.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-12-12T06:36:40.270 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2022-12-12T06:36:40.328 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2022-12-12T06:36:40.328 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2022-12-12T06:36:40.328 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-12-12T06:36:40.329 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-12-12T06:36:40.331 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-12-12T06:36:40.350 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2022-12-12T06:36:40.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-12-12T06:36:40.611 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2022-12-12T06:36:40.669 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2022-12-12T06:36:40.669 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8"
2022-12-12T06:36:40.669 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2022-12-12T06:36:40.669 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-12-12T06:36:40.670 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-12-12T06:36:40.671 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-12-12T06:36:40.779 INFO:teuthology.dispatcher.supervisor:Running job 7112861
2022-12-12T06:36:40.780 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-12-12_06:30:28-fs-wip-vshankar-testing-20221209.043803-testing-default-smithi/7112861 --name vshankar-2022-12-12_06:30:28-fs-wip-vshankar-testing-20221209.043803-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} -- /home/teuthworker/archive/vshankar-2022-12-12_06:30:28-fs-wip-vshankar-testing-20221209.043803-testing-default-smithi/7112861/orig.config.yaml
2022-12-12T06:36:40.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-12-12_06:30:28-fs-wip-vshankar-testing-20221209.043803-testing-default-smithi/7112861
2022-12-12T06:36:40.785 INFO:teuthology.dispatcher.supervisor:Job PID: 27892
2022-12-12T06:36:40.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-12-12T18:37:32.117 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-12-12T18:37:32.635 INFO:teuthology.kill:Killing Pids: {27892}
2022-12-12T18:37:33.476 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-12-12T18:37:33.476 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-12-12T18:37:33.477 INFO:teuthology.misc:Compressing logs...
2022-12-12T18:37:33.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-12-12T18:37:33.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-12-12T18:37:34.261 INFO:teuthology.misc:Compressing logs...
2022-12-12T18:37:34.618 INFO:teuthology.misc:Compressing logs...
2022-12-12T18:41:56.010 INFO:teuthology.kill:No teuthology processes running
2022-12-12T18:41:56.866 INFO:teuthology.kill:Nuking machines: ['smithi099', 'smithi170']
2022-12-12T18:41:57.416 INFO:teuthology.kill:2022-12-12 18:41:57,416.416 INFO:teuthology.nuke:targets:
2022-12-12T18:41:57.416 INFO:teuthology.kill:  smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAge3grGMps3akCWAYxRpig9YReD/mRPO6hdAJEF8N+917zYxq/eW6AhV32Qq4PkHHS3+E9ewoROqyOy1A1eI4=
2022-12-12T18:41:57.417 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaLfPRBGIyZb/7Zf00ekOltrUvNakJJXrPIly1P+tk6aS3O01q98QWW9NYADJ1O0M7tT5tq5DWKWq2to+tIEkzJUs3oaeTmTDqU9kPAkCv5iKu0qrEbX0Y7XFwWud92HAvgvc0mQN9PTix9t6p06HKHMdUu8qXhcXq9rVLetcfEcTDO7FS8G25aso5EHPgQxDGrKp797+KfcB5p1yZZ2o7yJH0r7b9sNaIG3dkqdjCG57MkystefDhFKMeuhkpw68gmgNdV7uQXI3hLs+k934Z0Altye9xO3YztyhVJJqm7M4LHL1AV0OQzZw6pAL0Cy3RbIxbcLywePBoAuQU4tEz6Sze9l7XZHzzB6gBH7kVEBUsqbNAYkg0Cua8g1Lmt+1aneREVxQ3AcTsrfLn5i+DubB5QFhjlmawQnTu6bWIFqNPyp8+gYdL0OWU2I9qwNKte2Ij/bBY90OEFbkcn4Hqmgrii3Roixr4vtm4nEcQiL7YJGXcdIyFKqQFuP5B2/c=
2022-12-12T18:41:57.417 INFO:teuthology.kill:2022-12-12 18:41:57,416.416 INFO:teuthology.nuke:Checking targets against current locks
2022-12-12T18:41:57.466 INFO:teuthology.kill:2022-12-12 18:41:57,466.466 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-12T18:41:57.490 INFO:teuthology.kill:2022-12-12 18:41:57,490.490 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-12T18:41:57.544 INFO:teuthology.kill:2022-12-12 18:41:57,544.544 INFO:teuthology.orchestra.console:Power off smithi099
2022-12-12T18:41:57.588 INFO:teuthology.kill:2022-12-12 18:41:57,588.588 INFO:teuthology.orchestra.console:Power off smithi170
2022-12-12T18:42:05.949 INFO:teuthology.kill:2022-12-12 18:42:05,949.949 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-12-12T18:42:06.099 INFO:teuthology.kill:2022-12-12 18:42:06,099.099 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2022-12-12T18:42:10.044 INFO:teuthology.kill:2022-12-12 18:42:10,043.043 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-12-12T18:42:10.192 INFO:teuthology.kill:2022-12-12 18:42:10,192.192 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2022-12-12T18:44:10.434 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15