2023-03-25T16:38:01.728 INFO:root:teuthology version: 0.0.1.dev1+ge372916
2023-03-25T16:38:01.878 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging
2023-03-25T16:38:01.881 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server
2023-03-25T16:38:01.881 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-03-25T16:38:01.907 INFO:teuthology.lock.ops:Node 'smithi038.front.sepia.ceph.com' reimaging is complete
2023-03-25T16:38:01.907 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-03-25T16:38:01.907 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-03-25T16:38:01.908 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-03-25T16:38:01.930 INFO:teuthology.lock.ops:Node 'smithi196.front.sepia.ceph.com' reimaging is complete
2023-03-25T16:38:02.066 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream
2023-03-25T16:38:02.091 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2023-03-25T16:38:02.299 INFO:teuthology.orchestra.console:Power off smithi038
2023-03-25T16:38:02.344 INFO:teuthology.orchestra.console:Power off smithi196
2023-03-25T16:38:10.684 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-03-25T16:38:10.706 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-03-25T16:38:10.786 INFO:teuthology.orchestra.console:Power on smithi038
2023-03-25T16:38:10.815 INFO:teuthology.orchestra.console:Power on smithi196
2023-03-25T16:38:19.160 INFO:teuthology.orchestra.console:Power on for smithi038 completed
2023-03-25T16:38:19.175 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2023-03-25T16:38:19.261 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2023-03-25T16:38:19.275 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-03-25T16:40:50.163 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-25T16:40:51.280 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-25T16:40:52.395 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-25T16:40:53.470 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-25T16:41:08.197 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:17.253 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:26.313 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:35.369 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:44.421 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:53.477 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-25T16:41:54.472 WARNING:teuthology.provision.fog:timed out
2023-03-25T16:42:32.319 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-25T16:42:48.004 INFO:teuthology.provision.fog.smithi038:Node is ready
2023-03-25T16:42:48.027 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com
2023-03-25T16:42:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038
2023-03-25T16:42:48.461 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2023-03-25T16:42:59.480 WARNING:teuthology.provision.fog:timed out
2023-03-25T16:43:05.804 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-25T16:43:06.071 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-03-25T16:43:06.132 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-03-25T16:43:06.192 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-03-25T16:43:06.542 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-03-25T16:43:06.709 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2023-03-25T16:43:06.710 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-25T16:43:06.734 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-03-25T16:43:06.734 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-25T16:43:06.760 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2023-03-25T16:43:06.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-03-25T16:43:07.016 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2023-03-25T16:43:07.073 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-03-25T16:43:07.074 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-25T16:43:07.075 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-25T16:43:07.076 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-03-25T16:43:07.101 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-03-25T16:43:07.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-03-25T16:43:07.292 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-03-25T16:43:07.350 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-03-25T16:43:07.350 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-03-25T16:43:07.350 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-03-25T16:43:07.350 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-03-25T16:43:07.350 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-25T16:43:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-25T16:43:07.352 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-25T16:43:07.352 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-03-25T16:43:07.459 INFO:teuthology.dispatcher.supervisor:Running job 7213479
2023-03-25T16:43:07.459 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_main/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7213479 --name vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} -- /home/teuthworker/archive/vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7213479/orig.config.yaml
2023-03-25T16:43:07.463 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7213479
2023-03-25T16:43:07.464 INFO:teuthology.dispatcher.supervisor:Job PID: 28886
2023-03-25T16:43:07.464 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-26T04:43:31.288 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-26T04:43:31.902 INFO:teuthology.kill:Killing Pids: {28886}
2023-03-26T04:43:32.938 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2023-03-26T04:43:32.940 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2023-03-26T04:43:32.940 INFO:teuthology.misc:Compressing logs...
2023-03-26T04:43:32.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-03-26T04:43:33.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-03-26T04:43:33.777 INFO:teuthology.misc:Compressing logs...
2023-03-26T04:43:34.148 INFO:teuthology.misc:Compressing logs...
2023-03-26T04:48:48.187 INFO:teuthology.kill:No teuthology processes running
2023-03-26T04:48:49.062 INFO:teuthology.kill:Nuking machines: ['smithi038', 'smithi196']
2023-03-26T04:48:49.707 INFO:teuthology.kill:2023-03-26 04:48:49,706.706 INFO:teuthology.nuke:targets:
2023-03-26T04:48:49.708 INFO:teuthology.kill:  smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIQMrpU9BexSNsIAyV17yTKSNHUs9dpEYYDZS4UUruKBPLmSLyeP2Jo3d/uBr+6iwu2MXswXyiMnjMjbc79zOk=
2023-03-26T04:48:49.708 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgnOGVMUyK3dL9CsJIRffo6qyTJFXxqmxANU7GvXB/Gq7jLbsgfo7H27HqDVK8jmkNgjrIVNXW7i3gB8F7Q1M+NmZKMPnMujze+UD14dOmPpJjCUmNR+xm27fm8byBoqbCUjhaXz3FQm4LRHc+glHJzz9+PfFfM3tl/lA5yLHL4RxxWxLnC+nf62sOP18J5CREh76vS+L/VUl7TeXvfUgZEIJmf/NkdMPYalJS4siFFDMO2OMverCT33Gr1UJOuP1N1Nqp2SJdSNBIpw2qkIk0n90UcDjkHWSjkEJJv4x/Mm93djPOYLBSTilsUFUxmVD0QeoQoprPYh3METVTJy4poKtRjKu+ntHPUR4P4UFeLrRSsp90Uf9bHfSBu0VjCrO86yvjQDaarnSJlK+5yqG+SrYbF8PTw2lQkfawVKucLilIM1QLniTtHLInoCgEelAxB81Ne6z7jh/mEh+6S1i9zij0lxFKZTczPuHUQhDxXZnFNRQku38zeU5oNP7VSwk=
2023-03-26T04:48:49.708 INFO:teuthology.kill:2023-03-26 04:48:49,707.707 INFO:teuthology.nuke:Checking targets against current locks
2023-03-26T04:48:49.781 INFO:teuthology.kill:2023-03-26 04:48:49,780.780 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-26T04:48:49.809 INFO:teuthology.kill:2023-03-26 04:48:49,809.809 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-26T04:48:49.872 INFO:teuthology.kill:2023-03-26 04:48:49,871.871 INFO:teuthology.orchestra.console:Power off smithi038
2023-03-26T04:48:49.913 INFO:teuthology.kill:2023-03-26 04:48:49,913.913 INFO:teuthology.orchestra.console:Power off smithi196
2023-03-26T04:48:58.249 INFO:teuthology.kill:2023-03-26 04:48:58,249.249 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-03-26T04:48:58.402 INFO:teuthology.kill:2023-03-26 04:48:58,401.401 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2023-03-26T04:49:02.396 INFO:teuthology.kill:2023-03-26 04:49:02,396.396 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-03-26T04:49:02.559 INFO:teuthology.kill:2023-03-26 04:49:02,559.559 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2023-03-26T04:51:02.841 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15