2023-03-03T06:27:24.354 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8
2023-03-03T06:27:24.497 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2023-03-03T06:27:24.499 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2023-03-03T06:27:24.499 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-03-03T06:27:24.520 INFO:teuthology.lock.ops:Node 'smithi039.front.sepia.ceph.com' reimaging is complete
2023-03-03T06:27:24.521 INFO:teuthology.lock.ops:Start node 'smithi085.front.sepia.ceph.com' reimaging
2023-03-03T06:27:24.521 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: reset os type and version on server
2023-03-03T06:27:24.521 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2023-03-03T06:27:24.545 INFO:teuthology.lock.ops:Node 'smithi085.front.sepia.ceph.com' reimaging is complete
2023-03-03T06:27:24.685 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream
2023-03-03T06:27:24.700 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream
2023-03-03T06:27:24.972 INFO:teuthology.orchestra.console:Power off smithi039
2023-03-03T06:27:25.019 INFO:teuthology.orchestra.console:Power off smithi085
2023-03-03T06:27:33.385 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2023-03-03T06:27:33.487 INFO:teuthology.orchestra.console:Power on smithi085
2023-03-03T06:27:37.467 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2023-03-03T06:27:37.569 INFO:teuthology.orchestra.console:Power on smithi039
2023-03-03T06:27:41.859 INFO:teuthology.orchestra.console:Power on for smithi085 completed
2023-03-03T06:27:41.960 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish
2023-03-03T06:27:45.940 INFO:teuthology.orchestra.console:Power on for smithi039 completed
2023-03-03T06:27:46.041 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2023-03-03T06:30:31.049 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:30:40.133 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:30:49.189 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:30:58.245 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:31:05.157 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:07.301 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:31:14.217 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:16.357 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85
2023-03-03T06:31:23.305 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:32.393 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:41.481 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:50.565 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:31:59.621 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:32:08.677 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:32:17.737 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-03-03T06:32:22.366 WARNING:teuthology.provision.fog:timed out
2023-03-03T06:32:28.647 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-03T06:32:28.918 INFO:teuthology.provision.fog.smithi085:Node is ready
2023-03-03T06:32:28.977 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com
2023-03-03T06:32:29.036 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085
2023-03-03T06:32:29.388 INFO:teuthology.provision.fog.smithi085:Deploy complete!
2023-03-03T06:33:23.788 WARNING:teuthology.provision.fog:timed out
2023-03-03T06:33:30.190 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-03T06:33:30.457 INFO:teuthology.provision.fog.smithi039:Node is ready
2023-03-03T06:33:30.517 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2023-03-03T06:33:30.576 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2023-03-03T06:33:30.923 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2023-03-03T06:33:31.096 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2023-03-03T06:33:31.097 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-03T06:33:31.125 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com
2023-03-03T06:33:31.126 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-03T06:33:31.151 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2023-03-03T06:33:31.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-03-03T06:33:31.341 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2023-03-03T06:33:31.399 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2023-03-03T06:33:31.399 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8"
2023-03-03T06:33:31.399 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2023-03-03T06:33:31.399 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2023-03-03T06:33:31.400 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-03T06:33:31.401 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-03T06:33:31.401 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-03T06:33:31.402 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-03-03T06:33:31.425 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server
2023-03-03T06:33:31.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2023-03-03T06:33:31.687 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64
2023-03-03T06:33:31.746 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8"
2023-03-03T06:33:31.747 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-03T06:33:31.748 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-03T06:33:31.749 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2023-03-03T06:33:31.891 INFO:teuthology.dispatcher.supervisor:Running job 7192163
2023-03-03T06:33:31.891 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192163 --name vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192163/orig.config.yaml
2023-03-03T06:33:31.895 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192163
2023-03-03T06:33:31.896 INFO:teuthology.dispatcher.supervisor:Job PID: 24173
2023-03-03T06:33:31.896 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-03T18:34:27.005 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-03T18:34:27.251 INFO:teuthology.kill:Killing Pids: {24173}
2023-03-03T18:34:28.052 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-03-03T18:34:28.053 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']
2023-03-03T18:34:28.054 INFO:teuthology.misc:Compressing logs...
2023-03-03T18:34:28.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-03-03T18:34:28.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2023-03-03T18:34:28.896 INFO:teuthology.misc:Compressing logs...
2023-03-03T18:34:29.359 INFO:teuthology.misc:Compressing logs...
2023-03-03T18:37:31.129 INFO:teuthology.kill:No teuthology processes running
2023-03-03T18:37:31.884 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi085']
2023-03-03T18:37:32.444 INFO:teuthology.kill:2023-03-03 18:37:32,444.444 INFO:teuthology.nuke:targets:
2023-03-03T18:37:32.445 INFO:teuthology.kill:  smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDygVhnAvdkk3m+ecyP2NKOr+fNKFKVzFVzOuyIZBukXFQHjYRBXRhZ0PWTKnNQ429nVqzI6txHmR/kfPl+OCJQlC5GA9uWGMf1eO86hqKPnM/f6DEYBFRaABl+doGt0BokpzJPgW6/30JnrI1qV4an5pOWABihw9+0as6KSw6b7y/r3YlGRtWZPblFjg92IxYLDWSWNnT4N9KRbOkZkt1ffdQPABmY0w+lMOmTtKgcIf4DNmyJSQJkS8riAUDB1SOkayyjGppx8X7I6hYtPRyYPjYMpJQgEFog1TfnwmrOBf67/JCXPCy8JB4GpDtAqZCzilQEkOOjtfXD+VGlJ4A6GehK+GKn0inirY9vygyjpwT1qba0Cpkgw6mPbQyvkNPnaVWOMprzvW+PGI/FQrAy/DvPzb7nHkEMbSD3G4+YSJcKhJXlfPPVro6KLrTZQCtp4J1cZ6CY+BXHvrSLZCkEMCBuE0OGcprfyDnDRBUQB+1o5C3UEwY66308jnanPfs=
2023-03-03T18:37:32.445 INFO:teuthology.kill:  smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBGDZqf5mjE8jy5+M3Zqxb8Sa7KmcVG0LFopViY3ELgwxBso2EGZVl3eg/4m4QQj8xZpU2OKcY7eWRQqnrZNYzheP7KTdEEXnR6bHcC1fz2+BxRyaUZmxUFaaCChp8ytctL+hvu9Oy22NnR+nIIq/kLC3eNI8wh48Quz34TJfCKBhy2emPFo47FoMicsHlK+Nm2Q8laMwHeUvNymYOdCuMMC1misTBAvgfZzUyN1CSxVpytAHVmA/pBKS/sH79iL8NvdBLZzLwyJqmP0LeDB10LtKuJMhFSOUoQz3INzR+TOQ6pRj7NBvgdbAu2Nwjoa+c2SqfA1KX7MbRnfn6A3kA5Y43gQTnoBCVyJTsW+yCzsPUbId1JPKmj0RCPdw9XLM5TeRhG8vRN8nnzBTN65R+SwxG4TfpCSzBcvjJYChWnbMWyKvFwMDD7CUFkBBH3uQfjSdGYumXn2QMMYMTz2y2Z5zD5af44Vfc5LX51DkckCHNSWkGM6aJfkydWdpHvfk=
2023-03-03T18:37:32.445 INFO:teuthology.kill:2023-03-03 18:37:32,444.444 INFO:teuthology.nuke:Checking targets against current locks
2023-03-03T18:37:32.501 INFO:teuthology.kill:2023-03-03 18:37:32,501.501 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-03T18:37:32.525 INFO:teuthology.kill:2023-03-03 18:37:32,525.525 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-03T18:37:32.577 INFO:teuthology.kill:2023-03-03 18:37:32,576.576 INFO:teuthology.orchestra.console:Power off smithi039
2023-03-03T18:37:32.595 INFO:teuthology.kill:2023-03-03 18:37:32,595.595 INFO:teuthology.orchestra.console:Power off smithi085
2023-03-03T18:37:40.962 INFO:teuthology.kill:2023-03-03 18:37:40,962.962 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2023-03-03T18:37:41.119 INFO:teuthology.kill:2023-03-03 18:37:41,119.119 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com
2023-03-03T18:37:45.084 INFO:teuthology.kill:2023-03-03 18:37:45,083.083 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2023-03-03T18:37:45.244 INFO:teuthology.kill:2023-03-03 18:37:45,243.243 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2023-03-03T18:39:45.651 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-03T18:39:45.767 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-03_17:40:00-upgrade:pacific-x-reef-distro-default-smithi/7192546
2023-03-03T18:39:45.767 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-03_17:40:00-upgrade:pacific-x-reef-distro-default-smithi/7192546