2023-03-27T10:32:58.557 INFO:root:teuthology version: 0.0.1.dev1+ge372916
2023-03-27T10:32:58.698 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2023-03-27T10:32:58.699 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2023-03-27T10:32:58.700 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2023-03-27T10:32:58.725 INFO:teuthology.lock.ops:Node 'smithi165.front.sepia.ceph.com' reimaging is complete
2023-03-27T10:32:58.725 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-03-27T10:32:58.726 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-03-27T10:32:58.726 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-03-27T10:32:58.750 INFO:teuthology.lock.ops:Node 'smithi196.front.sepia.ceph.com' reimaging is complete
2023-03-27T10:32:58.892 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2023-03-27T10:32:58.895 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2023-03-27T10:32:59.186 INFO:teuthology.orchestra.console:Power off smithi196
2023-03-27T10:32:59.205 INFO:teuthology.orchestra.console:Power off smithi165
2023-03-27T10:32:59.337 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-03-27T10:32:59.348 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2023-03-27T10:32:59.438 INFO:teuthology.orchestra.console:Power on smithi196
2023-03-27T10:32:59.449 INFO:teuthology.orchestra.console:Power on smithi165
2023-03-27T10:33:03.704 INFO:teuthology.orchestra.console:Power on for smithi165 completed
2023-03-27T10:33:03.805 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2023-03-27T10:33:07.807 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2023-03-27T10:33:07.908 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-03-27T10:36:08.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165
2023-03-27T10:36:11.909 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-27T10:36:17.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165
2023-03-27T10:36:20.965 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-27T10:36:26.181 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165
2023-03-27T10:36:30.021 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-27T10:36:35.237 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165
2023-03-27T10:36:39.081 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-03-27T10:36:44.293 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165
2023-03-27T10:37:45.137 WARNING:teuthology.provision.fog:timed out
2023-03-27T10:37:50.305 WARNING:teuthology.provision.fog:timed out
2023-03-27T10:37:51.474 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-27T10:37:51.758 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-03-27T10:37:51.776 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-03-27T10:37:51.835 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-03-27T10:37:52.187 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-03-27T10:37:56.575 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-27T10:37:56.831 INFO:teuthology.provision.fog.smithi165:Node is ready
2023-03-27T10:37:56.850 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2023-03-27T10:37:56.910 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2023-03-27T10:37:57.271 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2023-03-27T10:37:57.473 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2023-03-27T10:37:57.474 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-27T10:37:57.502 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-03-27T10:37:57.502 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-27T10:37:57.528 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2023-03-27T10:37:57.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2023-03-27T10:37:57.718 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2023-03-27T10:37:57.775 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-27T10:37:57.776 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2023-03-27T10:37:57.777 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-27T10:37:57.777 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2023-03-27T10:37:57.777 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-27T10:37:57.777 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-27T10:37:57.777 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-27T10:37:57.778 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2023-03-27T10:37:57.802 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-03-27T10:37:57.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-03-27T10:37:57.995 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-03-27T10:37:58.054 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-03-27T10:37:58.054 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-03-27T10:37:58.054 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-03-27T10:37:58.054 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-03-27T10:37:58.054 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-27T10:37:58.055 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-27T10:37:58.056 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-27T10:37:58.056 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-03-27T10:37:58.169 INFO:teuthology.dispatcher.supervisor:Running job 7221328
2023-03-27T10:37:58.170 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_main/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221328 --name rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/0-pacific 1-client-upgrade 2-workload/stress_tests/blogbench}} -- /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221328/orig.config.yaml
2023-03-27T10:37:58.173 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221328
2023-03-27T10:37:58.175 INFO:teuthology.dispatcher.supervisor:Job PID: 20034
2023-03-27T10:37:58.175 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-27T22:38:52.969 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-27T22:38:53.113 INFO:teuthology.kill:Killing Pids: {20034}
2023-03-27T22:38:53.994 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2023-03-27T22:38:53.995 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['client.0']
2023-03-27T22:38:53.995 INFO:teuthology.misc:Compressing logs...
2023-03-27T22:38:53.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2023-03-27T22:38:54.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-03-27T22:38:54.687 INFO:teuthology.misc:Compressing logs...
2023-03-27T22:38:54.748 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory
2023-03-27T22:38:54.753 INFO:teuthology.orchestra.run.smithi196.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory
2023-03-27T22:38:54.818 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory
2023-03-27T22:38:54.819 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now
2023-03-27T22:38:54.884 INFO:teuthology.orchestra.run.smithi196.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory
2023-03-27T22:38:54.884 INFO:teuthology.orchestra.run.smithi196.stderr:tar: Error is not recoverable: exiting now
2023-03-27T22:38:54.887 INFO:teuthology.misc:Compressing logs...
2023-03-27T22:39:37.749 INFO:teuthology.kill:No teuthology processes running
2023-03-27T22:39:38.692 INFO:teuthology.kill:Nuking machines: ['smithi165', 'smithi196']
2023-03-27T22:39:39.332 INFO:teuthology.kill:2023-03-27 22:39:39,332.332 INFO:teuthology.nuke:targets:
2023-03-27T22:39:39.333 INFO:teuthology.kill:  smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2EhXIU/t9xmM6Zx80iPKxqQc12HSPj1+tQk6qvcjJ4kjfn4m92fg0OKS2WqBQrpUvyo1u9HCRXNCoLGbLECM105GlzsL2RnnDDX7ss7wyFxb8k5/m9DwvDkAYmtRlAEI0S5TYbI88DIZxxdIUUoF0KzGcPe7rs+/BF3qeoxN2UprVzKSNa15Pyuu0aS0X2GRVp7RGWrLqty4Ts9yWLt5pzZcmwwdzIjZ3B7xVV9RTp8xt1vdF3WsLSvsgqYMQF3lNJFQYlf1ReTeOh+4a5JtlRUplE3WUv/iDT4rm+Z62ghXcJdD4dSs8fln2N9HJ67BU1kN+MiEZmxaxRjeQbwKkI5VCjwSm1eEYFjOdHX4VQbO/uR/I52AAAFK+3FXCgQ7P1gjDocOiz/Z3CGc2XSkmPubptHhoXfPGpr+u66CPmRPYuO/8rF9cvh9g33eWI1Rp5xnQ++fdbR3YEc87tvKSD1+5Mb2RUEnEdcRuAsF/+9F8xxPXNPgkf7dcNy8rlW0=
2023-03-27T22:39:39.333 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOdcEiGYXOlQlkt3QwLK8RoeWgUqVSPQSXCjJoeUtWmg9Y5a/lu8RuOkQuU0pQUlHB0WqaFfTwZn4wiKm21nxJ75zp3LiB7U+nEaBfCCTkxK3cuO5FgEfXSCbxCFz5kPDi6KCpUR56Z7Udbi5HffSxzXkSPeAtaMa5NuKYZe3pN8kGdMbYcxuySwnmBCqLx98KLKSiUuDFzKVsz8YnP03x/VAR+rBDhLhrCfnXunDZXUkVn/oAUdAKm7C0NEcRCDshMWsrpEhvAUasp/sbWKceRv78Rqpv2kkTTYmPpxShbKk6XMSjxcoL7YKi60WWsTKgFtHlkXg/fvbUTRn+fSPQl8fPjN6LuwkskoI/fM9QqKr8HZ1VGyce0s3JHXzT9qz4T1nbNbfU5YOutNeO2ee7IYUCAnCrH0pjn5V9zFG9KjEJgNk2Tb3VeLdAbvymka3a9L4Io9N6gqp5CL26ckEWidhMISf3x0F2mCYcg22QIscLAeMuc0tVbKVdXq2xL8=
2023-03-27T22:39:39.334 INFO:teuthology.kill:2023-03-27 22:39:39,332.332 INFO:teuthology.nuke:Checking targets against current locks
2023-03-27T22:39:39.389 INFO:teuthology.kill:2023-03-27 22:39:39,388.388 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-27T22:39:39.424 INFO:teuthology.kill:2023-03-27 22:39:39,423.423 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-27T22:39:39.481 INFO:teuthology.kill:2023-03-27 22:39:39,481.481 INFO:teuthology.orchestra.console:Power off smithi165
2023-03-27T22:39:39.527 INFO:teuthology.kill:2023-03-27 22:39:39,527.527 INFO:teuthology.orchestra.console:Power off smithi196
2023-03-27T22:39:47.873 INFO:teuthology.kill:2023-03-27 22:39:47,872.872 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2023-03-27T22:39:48.033 INFO:teuthology.kill:2023-03-27 22:39:48,033.033 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com
2023-03-27T22:39:52.007 INFO:teuthology.kill:2023-03-27 22:39:52,007.007 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-03-27T22:39:52.164 INFO:teuthology.kill:2023-03-27 22:39:52,164.164 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2023-03-27T22:41:52.539 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-27T22:41:52.661 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/lflores-2023-03-27_20:42:09-rados-wip-aclamk-bs-elastic-shared-blob-quincy-distro-default-smithi/7221627
2023-03-27T22:41:52.662 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi196 but it was locked by another job: /home/teuthworker/archive/lflores-2023-03-27_20:42:09-rados-wip-aclamk-bs-elastic-shared-blob-quincy-distro-default-smithi/7221627