2023-04-30T09:01:44.160 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-04-30T09:01:44.304 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2023-04-30T09:01:44.305 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2023-04-30T09:01:44.306 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-04-30T09:01:44.330 INFO:teuthology.lock.ops:Node 'smithi003.front.sepia.ceph.com' reimaging is complete
2023-04-30T09:01:44.331 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2023-04-30T09:01:44.331 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2023-04-30T09:01:44.331 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2023-04-30T09:01:44.355 INFO:teuthology.lock.ops:Node 'smithi090.front.sepia.ceph.com' reimaging is complete
2023-04-30T09:01:44.501 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream
2023-04-30T09:01:44.504 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream
2023-04-30T09:01:44.756 INFO:teuthology.orchestra.console:Power off smithi003
2023-04-30T09:01:44.773 INFO:teuthology.orchestra.console:Power off smithi090
2023-04-30T09:01:53.132 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-04-30T09:01:53.234 INFO:teuthology.orchestra.console:Power on smithi003
2023-04-30T09:01:57.252 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2023-04-30T09:01:57.353 INFO:teuthology.orchestra.console:Power on smithi090
2023-04-30T09:01:57.489 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2023-04-30T09:01:57.590 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2023-04-30T09:02:05.719 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2023-04-30T09:02:05.820 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2023-04-30T09:04:46.537 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-04-30T09:04:55.589 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-04-30T09:05:04.645 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-04-30T09:05:13.701 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-04-30T09:05:22.757 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-04-30T09:05:24.937 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:05:34.021 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:05:43.081 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:05:52.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:06:01.225 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:06:10.313 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:06:19.401 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-04-30T09:06:28.765 WARNING:teuthology.provision.fog:timed out
2023-04-30T09:06:35.032 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-04-30T09:06:35.338 INFO:teuthology.provision.fog.smithi003:Node is ready
2023-04-30T09:06:35.358 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2023-04-30T09:06:35.417 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2023-04-30T09:06:35.775 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2023-04-30T09:07:25.453 WARNING:teuthology.provision.fog:timed out
2023-04-30T09:07:31.801 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-04-30T09:07:32.163 INFO:teuthology.provision.fog.smithi090:Node is ready
2023-04-30T09:07:32.179 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2023-04-30T09:07:32.237 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2023-04-30T09:07:32.587 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2023-04-30T09:07:32.760 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2023-04-30T09:07:32.761 INFO:teuthology.lock.ops:New key found. Updating...
2023-04-30T09:07:32.790 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2023-04-30T09:07:32.790 INFO:teuthology.lock.ops:New key found. Updating...
2023-04-30T09:07:32.816 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2023-04-30T09:07:32.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-04-30T09:07:33.078 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2023-04-30T09:07:33.138 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8"
2023-04-30T09:07:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-04-30T09:07:33.140 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-04-30T09:07:33.140 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2023-04-30T09:07:33.140 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-04-30T09:07:33.140 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-04-30T09:07:33.140 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-04-30T09:07:33.141 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-04-30T09:07:33.166 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2023-04-30T09:07:33.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2023-04-30T09:07:33.355 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2023-04-30T09:07:33.414 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2023-04-30T09:07:33.414 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8"
2023-04-30T09:07:33.414 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2023-04-30T09:07:33.415 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2023-04-30T09:07:33.415 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8"
2023-04-30T09:07:33.415 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2023-04-30T09:07:33.415 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8"
2023-04-30T09:07:33.416 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2023-04-30T09:07:33.416 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-04-30T09:07:33.416 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2023-04-30T09:07:33.416 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-04-30T09:07:33.417 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-04-30T09:07:33.417 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-04-30T09:07:33.418 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2023-04-30T09:07:33.541 INFO:teuthology.dispatcher.supervisor:Running job 7256703
2023-04-30T09:07:33.621 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_kapandya@teuthology --archive /home/teuthworker/archive/kapandya-2023-04-28_06:37:55-rgw-wip-rgw-yield-work-distro-default-smithi/7256703 --name kapandya-2023-04-28_06:37:55-rgw-wip-rgw-yield-work-distro-default-smithi --description rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/kapandya-2023-04-28_06:37:55-rgw-wip-rgw-yield-work-distro-default-smithi/7256703/orig.config.yaml
2023-04-30T09:07:33.625 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kapandya-2023-04-28_06:37:55-rgw-wip-rgw-yield-work-distro-default-smithi/7256703
2023-04-30T09:07:33.626 INFO:teuthology.dispatcher.supervisor:Job PID: 20498
2023-04-30T09:07:33.627 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-04-30T21:09:13.671 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-04-30T21:09:13.820 INFO:teuthology.kill:Killing Pids: {20498}
2023-04-30T21:09:14.690 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2023-04-30T21:09:14.690 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-04-30T21:09:14.691 INFO:teuthology.misc:Compressing logs...
2023-04-30T21:09:14.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-04-30T21:09:14.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2023-04-30T21:09:15.205 INFO:teuthology.misc:Compressing logs...
2023-04-30T21:09:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-04-30T21:09:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-04-30T21:09:15.238 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-04-30T21:09:15.238 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-04-30T21:09:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	/home/ubuntu/cephtest/archive/syslog/kern.log:	 84.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-04-30T21:09:15.239 INFO:teuthology.orchestra.run.smithi003.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	/home/ubuntu/cephtest/archive/syslog/kern.log:	 83.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-04-30T21:09:15.246 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-04-30T21:09:15.247 INFO:teuthology.orchestra.run.smithi003.stderr: 88.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-04-30T21:09:15.354 INFO:teuthology.misc:Compressing logs...
2023-04-30T21:09:15.389 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log
2023-04-30T21:09:15.390 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144952.log
2023-04-30T21:09:15.390 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.a.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144619.log
2023-04-30T21:09:15.390 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144952.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144952.log.gz
2023-04-30T21:09:15.391 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145368.log
2023-04-30T21:09:15.391 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log
2023-04-30T21:09:15.391 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144619.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144619.log.gz
2023-04-30T21:09:15.392 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145368.log:	gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145368.log.gz
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.131757.log
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/rgw.ceph.client.0.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138489.log
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.tmp-client.admin.131757.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145560.log
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.131757.log.gz
2023-04-30T21:09:15.393 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.138489.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144192.log
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138489.log.gz
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr: 94.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145560.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145560.log.gz
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144192.log:	gzip -5   0.0%--verbose --  -- replaced with /var/log/ceph/ceph-client.admin.144192.log.gz/var/log/ceph/ceph-client.admin.144607.log
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:
2023-04-30T21:09:15.394 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.1.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144962.log
2023-04-30T21:09:15.396 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144607.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144607.log.gz
2023-04-30T21:09:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144614.log
2023-04-30T21:09:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144950.log
2023-04-30T21:09:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144962.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144962.log.gz
2023-04-30T21:09:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144614.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log
2023-04-30T21:09:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144614.log.gz
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144950.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138359.log
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144950.log.gz
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mgr.y.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144027.log
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.138359.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144617.log
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138359.log.gz
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144027.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144027.log.gz
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144617.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144617.log.gz
2023-04-30T21:09:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145247.log
2023-04-30T21:09:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144876.log
2023-04-30T21:09:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145247.log:	gzip -5 --verbose -- /var/log/ceph/ceph.log
2023-04-30T21:09:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145247.log.gz
2023-04-30T21:09:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144876.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144876.log.gz
2023-04-30T21:09:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.log:	gzip -5 --verbose -- /var/log/ceph/ceph.audit.log
2023-04-30T21:09:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145319.log
2023-04-30T21:09:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145319.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145319.log.gz
2023-04-30T21:09:15.403 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log
2023-04-30T21:09:15.403 INFO:teuthology.orchestra.run.smithi003.stderr: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz
2023-04-30T21:09:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.3.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144123.log
2023-04-30T21:09:15.408 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144123.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144123.log.gz
2023-04-30T21:09:15.408 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137987.log
2023-04-30T21:09:15.408 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144616.log
2023-04-30T21:09:15.409 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.137987.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.137987.log.gz
2023-04-30T21:09:15.409 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144616.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144616.log.gz
2023-04-30T21:09:15.409 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144388.log
2023-04-30T21:09:15.410 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144388.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144388.log.gz
2023-04-30T21:09:15.410 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log
2023-04-30T21:09:15.413 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144608.log
2023-04-30T21:09:15.414 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144608.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144608.log.gz
2023-04-30T21:09:15.414 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145464.log
2023-04-30T21:09:15.415 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145464.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145464.log.gz
2023-04-30T21:09:15.415 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log
2023-04-30T21:09:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138181.log
2023-04-30T21:09:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.1.log
2023-04-30T21:09:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.138181.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138232.log
2023-04-30T21:09:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138181.log.gz
2023-04-30T21:09:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/rgw.ceph.client.1.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138029.log
2023-04-30T21:09:15.425 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.138232.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log
2023-04-30T21:09:15.425 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138232.log.gz
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.138029.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138029.log.gz
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138077.log
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr: 94.2% -- replaced with /var/log/ceph/rgw.ceph.client.1.log.gz
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.5.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144205.log
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.138077.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138077.log.gzgzip
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:-5 --verbose -- /var/log/ceph/ceph-osd.7.log
2023-04-30T21:09:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.144205.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137882.log
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144205.log.gz
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.7.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137930.log
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138125.log
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.137882.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.137882.log.gz
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.137930.log:	gzip -5 --verbose -- /var/log/ceph/ceph.log
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.137930.log.gz
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.138125.log:	gzip -5 --verbose -- /var/log/ceph/ceph.audit.log
2023-04-30T21:09:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.138125.log.gz
2023-04-30T21:09:15.428 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.c.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144290.log
2023-04-30T21:09:15.429 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144252.log
2023-04-30T21:09:15.429 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log:	/var/log/ceph/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144299.log
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.144252.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137979.log
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144252.log.gz
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.144299.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144299.log.gz
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr: 90.2% -- replaced with /var/log/ceph/ceph.audit.log.gz
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.137979.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
2023-04-30T21:09:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:  0.0% -- replaced with /var/log/ceph/ceph-client.admin.137979.log.gz
2023-04-30T21:09:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.b.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144158.log
2023-04-30T21:09:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.x.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log
2023-04-30T21:09:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.144158.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144158.log.gz
2023-04-30T21:09:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.6.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log
2023-04-30T21:09:15.437 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144290.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144290.log.gz
2023-04-30T21:09:15.437 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145007.log
2023-04-30T21:09:15.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145007.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145007.log.gz
2023-04-30T21:09:15.458 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144937.log
2023-04-30T21:09:15.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144937.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144937.log.gz
2023-04-30T21:09:15.463 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145013.log
2023-04-30T21:09:15.463 INFO:teuthology.orchestra.run.smithi003.stderr: 95.5% -- replaced with /var/log/ceph/ceph.log.gz
2023-04-30T21:09:15.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145013.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145013.log.gz
2023-04-30T21:09:15.464 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144339.log
2023-04-30T21:09:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.4.log:	 91.4% -- replaced with /var/log/ceph/ceph.log.gz
2023-04-30T21:09:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144339.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144339.log.gz
2023-04-30T21:09:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145221.log
2023-04-30T21:09:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145221.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145221.log.gz
2023-04-30T21:09:15.466 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144241.log
2023-04-30T21:09:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144241.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144241.log.gz
2023-04-30T21:09:15.467 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144618.log
2023-04-30T21:09:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144618.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144618.log.gz
2023-04-30T21:09:15.468 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145513.log
2023-04-30T21:09:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145513.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145513.log.gz
2023-04-30T21:09:15.469 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145609.log
2023-04-30T21:09:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145609.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145609.log.gz
2023-04-30T21:09:15.470 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144615.log
2023-04-30T21:09:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144615.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144615.log.gz
2023-04-30T21:09:15.472 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145417.log
2023-04-30T21:09:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.145417.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.145417.log.gz
2023-04-30T21:09:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144943.log
2023-04-30T21:09:15.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.144943.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.144943.log.gz
2023-04-30T21:09:15.672 INFO:teuthology.orchestra.run.smithi003.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz
2023-04-30T21:09:20.287 INFO:teuthology.orchestra.run.smithi090.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz
2023-04-30T21:09:23.128 INFO:teuthology.orchestra.run.smithi003.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz
2023-04-30T21:09:24.062 INFO:teuthology.orchestra.run.smithi090.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz
2023-04-30T21:09:31.363 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz
2023-04-30T21:09:32.440 INFO:teuthology.orchestra.run.smithi090.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz
2023-04-30T21:09:32.643 INFO:teuthology.orchestra.run.smithi003.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz
2023-04-30T21:09:33.454 INFO:teuthology.orchestra.run.smithi003.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
2023-04-30T21:09:36.233 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz
2023-04-30T21:09:36.482 INFO:teuthology.orchestra.run.smithi003.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz
2023-04-30T21:09:36.719 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz
2023-04-30T21:09:37.616 INFO:teuthology.orchestra.run.smithi003.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz
2023-04-30T21:09:40.595 INFO:teuthology.orchestra.run.smithi003.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
2023-04-30T21:10:00.890 INFO:teuthology.kill:No teuthology processes running
2023-04-30T21:10:01.769 INFO:teuthology.kill:Nuking machines: ['smithi003', 'smithi090']
2023-04-30T21:10:02.353 INFO:teuthology.kill:2023-04-30 21:10:02,353.353 INFO:teuthology.nuke:targets:
2023-04-30T21:10:02.354 INFO:teuthology.kill:  smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCw2VNFHQPrRg6Vju9tITDCjd9/YQZTmfU1fH7wFVSQBW/2IR/5c8E7tbf0kyCE748yU+sr0WUBe9ty/Ob40BgvJ0rKLSghT8Cd7N0GPolAbxCox4/wWdBp0Ic6G8L9Fu/vI6De4Q5+NOXel+cdeL0p57iRijtpxkVfGn+xBVnMC0XCta3JhKp2KKRUhrPL2yPVX+bAKnUH1nDxb/oTE1nGBwntEGglOyi+RtW/2aKrhgxYX/DrgfGsu3UVvIp99rXFYDELpr296t2WIteiYCZMd+skkHmXrWKL/QDyx5j575GjGBvFtuXKrZc6CEmjnlXLskN+n5BBqy/k7xc+fOYuLHbieGoj9E28yxw4nDtQ2hRaxOnUNfhjOKMr/enk12wb2rFMkqs8Iegbs4k0+yWvvnuWc9BJmdI7u2AcfN10+uxHClRqLrHU7wERd3cDxj8bGR1lDmkiq5d5NEI1e+TwD4b055pYowzohh0lEPKt39hrwfOjuRJbvWi+lOM5Ka8=
2023-04-30T21:10:02.354 INFO:teuthology.kill:  smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTncFSqcBYThUoHrcJMGnF+yTcrpoApQekbuKeK9HqzwE80DL/ogipSpevRlEM4GAG9n9ollCIEjib+3plAoxznDvCKLBAMrb7kcGfPcLG6CBDVrhjROZEHvEagC3dVOxqjpZgXJFIklT0rGlb3b7hPK9iSzpVDhSFdg6ujwSgP7UY0gyhmupGmSHm4Jq7MaL0pS18FXS55H5Rsm2dZDNPagb5fZOxJOsE0YhFpAHdlAeuYtCZLjRPaQp8xW1eIo2+kU/RbeiiYM1zUP8o9VIh6wic+TgrNgqK2v+agTi6vFxQfyzyTddP9tRAUMTvkO7NJpZFzlkKOLvYFp/DfWGWCakcIDjWOknRvXDGiFfMxEUxdmhWE3YSz7FPI3y2Ade7TdQzSnBmNw0lhQr3PTh3aB9QNgbE3G4tlF5RltPF6QyX+zjX2cXwNsefPzzPqqilIeQ3dEaSiZOryQKekSWiYKFQE/sJTVGggLrj0xiAsYLFMszIoLmYXlt5dnWQvMk=
2023-04-30T21:10:02.355 INFO:teuthology.kill:2023-04-30 21:10:02,353.353 INFO:teuthology.nuke:Checking targets against current locks
2023-04-30T21:10:02.413 INFO:teuthology.kill:2023-04-30 21:10:02,413.413 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-30T21:10:02.428 INFO:teuthology.kill:2023-04-30 21:10:02,428.428 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-30T21:10:02.487 INFO:teuthology.kill:2023-04-30 21:10:02,487.487 INFO:teuthology.orchestra.console:Power off smithi003
2023-04-30T21:10:02.526 INFO:teuthology.kill:2023-04-30 21:10:02,526.526 INFO:teuthology.orchestra.console:Power off smithi090
2023-04-30T21:10:10.863 INFO:teuthology.kill:2023-04-30 21:10:10,863.863 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-04-30T21:10:11.098 INFO:teuthology.kill:2023-04-30 21:10:11,098.098 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2023-04-30T21:10:15.004 INFO:teuthology.kill:2023-04-30 21:10:15,003.003 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2023-04-30T21:10:15.154 INFO:teuthology.kill:2023-04-30 21:10:15,154.154 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2023-04-30T21:12:15.487 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-04-30T21:12:15.608 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi003 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-28_18:57:55-fs-reef-distro-default-smithi/7257223
2023-04-30T21:12:15.608 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-28_18:57:55-fs-reef-distro-default-smithi/7257226