2023-03-27T09:49:55.765 INFO:root:teuthology version: 0.0.1.dev1+ge372916 2023-03-27T09:49:55.926 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-03-27T09:49:55.927 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-03-27T09:49:55.927 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-03-27T09:49:55.950 INFO:teuthology.lock.ops:Node 'smithi086.front.sepia.ceph.com' reimaging is complete 2023-03-27T09:49:55.951 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-03-27T09:49:55.951 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-03-27T09:49:55.951 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-03-27T09:49:55.974 INFO:teuthology.lock.ops:Node 'smithi181.front.sepia.ceph.com' reimaging is complete 2023-03-27T09:49:56.116 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream 2023-03-27T09:49:56.137 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-03-27T09:49:56.365 INFO:teuthology.orchestra.console:Power off smithi086 2023-03-27T09:49:56.386 INFO:teuthology.orchestra.console:Power off smithi181 2023-03-27T09:50:04.764 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-03-27T09:50:04.866 INFO:teuthology.orchestra.console:Power on smithi181 2023-03-27T09:50:08.866 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-03-27T09:50:08.967 INFO:teuthology.orchestra.console:Power on smithi086 2023-03-27T09:50:13.237 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2023-03-27T09:50:13.338 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-03-27T09:50:17.345 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2023-03-27T09:50:17.446 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-03-27T09:53:02.373 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-03-27T09:53:06.409 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:53:11.429 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-03-27T09:53:15.465 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:53:20.485 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-03-27T09:53:24.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:53:29.541 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-03-27T09:53:33.573 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:53:38.597 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-03-27T09:53:42.633 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:53:51.721 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-03-27T09:54:29.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-27T09:54:44.602 WARNING:teuthology.provision.fog:timed out 2023-03-27T09:54:50.254 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-03-27T09:54:50.275 INFO:teuthology.orchestra.run.smithi086.stdout:smithi001 2023-03-27T09:54:50.333 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.1 smithi001 smithi001 2023-03-27T09:54:50.706 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-03-27T09:54:50.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-27T09:54:51.190 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-03-27T09:54:51.249 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-03-27T09:54:51.308 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-03-27T09:54:51.682 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-03-27T09:54:51.845 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-03-27T09:54:51.846 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-27T09:54:51.875 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-03-27T09:54:51.875 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-27T09:54:51.901 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-03-27T09:54:51.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-03-27T09:54:52.095 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-03-27T09:54:52.152 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2023-03-27T09:54:52.152 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-03-27T09:54:52.153 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-27T09:54:52.154 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2023-03-27T09:54:52.154 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-27T09:54:52.154 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-27T09:54:52.154 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-27T09:54:52.155 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-03-27T09:54:52.184 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-03-27T09:54:52.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-03-27T09:54:52.328 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-03-27T09:54:52.385 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-27T09:54:52.386 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-03-27T09:54:52.387 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-27T09:54:52.387 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-03-27T09:54:52.387 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-27T09:54:52.387 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-27T09:54:52.387 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-27T09:54:52.388 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-03-27T09:54:52.507 INFO:teuthology.dispatcher.supervisor:Running job 7221303 2023-03-27T09:54:52.507 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_main/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221303 --name rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/0-nautilus 1-client-upgrade 2-workload/stress_tests/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221303/orig.config.yaml 2023-03-27T09:54:52.511 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221303 2023-03-27T09:54:52.511 INFO:teuthology.dispatcher.supervisor:Job PID: 14222 2023-03-27T09:54:52.512 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-27T21:55:46.577 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-27T21:55:46.751 INFO:teuthology.kill:Killing Pids: {14222} 2023-03-27T21:55:47.605 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-03-27T21:55:47.606 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['client.0'] 2023-03-27T21:55:47.606 INFO:teuthology.misc:Compressing logs... 2023-03-27T21:55:47.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-03-27T21:55:47.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-03-27T21:55:48.426 INFO:teuthology.misc:Compressing logs... 2023-03-27T21:55:48.487 INFO:teuthology.orchestra.run.smithi086.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2023-03-27T21:55:48.491 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2023-03-27T21:55:48.555 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-03-27T21:55:48.556 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now 2023-03-27T21:55:48.617 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-03-27T21:55:48.618 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2023-03-27T21:55:48.620 INFO:teuthology.misc:Compressing logs... 2023-03-27T22:00:59.648 INFO:teuthology.kill:No teuthology processes running 2023-03-27T22:01:00.465 INFO:teuthology.kill:Nuking machines: ['smithi086', 'smithi181'] 2023-03-27T22:01:01.033 INFO:teuthology.kill:2023-03-27 22:01:01,033.033 INFO:teuthology.nuke:targets: 2023-03-27T22:01:01.034 INFO:teuthology.kill: smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0S7K4oRigwziDLkK36DrQkGvhdS9YzlbdkX2YAccXnPkoDHkBWbevtDytN4XqmGq5EOroXzWhO2q46HgMCCoXTiq34GiPbGv6mYBraQIhhoFBfvCbWRXORAIwCc++j11xjctd1xKuWGcZ+/qclljbsUoKgw9H7K/I4JCvrQt0WGVn3H4gssHNB1Y2TC1iS77qPd1+Yu36qm/9n6VsmjcsLq3lOXCazjDKklsDpu5RAJGcfrdz0L6mGxH43ewdcyoNMntvrw3+8PDyEpetRY8pTj8JnINuddpJqmbGZI7sOFXihjdcMlMjz1f9O02kf6wJd8U/Oc18RDwtmHdS79uZsSFqFacUR47EjxYyubykYTjwxIr4+CBvTZH1Hkbij0pbeXJ734//laoVwffN7ZVNJo1+pVhCLyuz5gMPI+W/6wgbD1VCP7ckba1D+lwTmCdn0snLs2ylA/B+Hfencrqe//A8U6+8U6lOnrOTsDGBR40GS9RZ+EyjCSOXvxYgZM= 2023-03-27T22:01:01.034 INFO:teuthology.kill: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqFW4glHTCJ4Y1oEhRCUhcYiHo1otpbPNzgCdt+NzmoaZ50C594UyVYXcB5xIx6g/YFsQKJHgnKme/UFYJhoEW1Jtp4vZFb5JKzTbQsTrz9CimKAXgJzPruZFfD/r4E0PIN3oweiG7ceOr7qdFub5Lh6MmblBXRRDm5Onaj2nAGzRodwF828YYECHf68FpKlLFXBNxkvq+sU4/kEuAIcz3RBZAHS/LkDB8E0kaKFeIxHCMW40I2fLOUhkJeFR0EEeRtXbSfpokf5MqbslTMhsWqjVWz4ebopxDzooawml3oR+S+xg8nGJuxnviVOfrEb5N8TybsyK1BFKCCPcfLRZrQOzSthzXcDRqlQlrPElZ+H++2ZUwOvffDJCekDY+RgAhAyHtIH38lyPzChYksI/NJQc6zyVK3IeE8WKVoteS04h2w8CbCmBq4zo0GsWpwoGhwbm2omfsKgS54YsgwzryZnuiTo5wwlzjvs8TzhGdmGFDIWBWUR6opHo6ydqqfk0= 2023-03-27T22:01:01.034 INFO:teuthology.kill:2023-03-27 22:01:01,033.033 INFO:teuthology.nuke:Checking targets against current locks 2023-03-27T22:01:01.085 INFO:teuthology.kill:2023-03-27 22:01:01,084.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-27T22:01:01.115 INFO:teuthology.kill:2023-03-27 22:01:01,114.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-27T22:01:01.152 INFO:teuthology.kill:2023-03-27 22:01:01,152.152 INFO:teuthology.orchestra.console:Power off smithi086 2023-03-27T22:01:01.192 INFO:teuthology.kill:2023-03-27 22:01:01,192.192 INFO:teuthology.orchestra.console:Power off smithi181 2023-03-27T22:01:13.642 INFO:teuthology.kill:2023-03-27 22:01:13,642.642 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-03-27T22:01:13.661 INFO:teuthology.kill:2023-03-27 22:01:13,661.661 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-03-27T22:01:13.799 INFO:teuthology.kill:2023-03-27 22:01:13,798.798 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-03-27T22:01:13.814 INFO:teuthology.kill:2023-03-27 22:01:13,814.814 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2023-03-27T22:03:14.131 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-27T22:03:14.240 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi086 but it was locked by another job: /home/teuthworker/archive/lflores-2023-03-27_20:42:09-rados-wip-aclamk-bs-elastic-shared-blob-quincy-distro-default-smithi/7221571 2023-03-27T22:03:14.240 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/lflores-2023-03-27_20:42:09-rados-wip-aclamk-bs-elastic-shared-blob-quincy-distro-default-smithi/7221571