2023-05-03T11:34:17.681 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-03T11:34:17.803 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-05-03T11:34:17.804 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-05-03T11:34:17.804 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-05-03T11:34:17.826 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete 2023-05-03T11:34:17.827 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-05-03T11:34:17.827 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-05-03T11:34:17.827 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-05-03T11:34:17.851 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete 2023-05-03T11:34:17.976 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-05-03T11:34:18.003 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2023-05-03T11:34:18.225 INFO:teuthology.orchestra.console:Power off smithi116 2023-05-03T11:34:18.281 INFO:teuthology.orchestra.console:Power off smithi154 2023-05-03T11:34:26.645 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-05-03T11:34:26.746 INFO:teuthology.orchestra.console:Power on smithi154 2023-05-03T11:34:30.709 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-05-03T11:34:30.810 INFO:teuthology.orchestra.console:Power on smithi116 2023-05-03T11:34:35.068 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2023-05-03T11:34:35.110 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-05-03T11:34:35.170 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-05-03T11:34:35.211 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-05-03T11:37:39.589 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-03T11:37:39.591 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-03T11:37:48.677 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-03T11:37:48.678 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-03T11:37:57.733 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-03T11:37:57.734 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-03T11:38:06.825 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-03T11:38:06.826 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-03T11:38:15.877 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-05-03T11:38:15.909 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-03T11:39:21.941 WARNING:teuthology.provision.fog:timed out 2023-05-03T11:39:21.943 WARNING:teuthology.provision.fog:timed out 2023-05-03T11:39:28.269 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-03T11:39:28.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-03T11:39:28.558 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-05-03T11:39:28.566 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-05-03T11:39:28.584 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-05-03T11:39:28.617 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-05-03T11:39:28.641 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-05-03T11:39:28.675 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-05-03T11:39:28.979 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-05-03T11:39:29.020 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-05-03T11:39:29.188 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-05-03T11:39:29.188 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-03T11:39:29.213 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-05-03T11:39:29.213 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-03T11:39:29.231 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-05-03T11:39:29.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-03T11:39:29.423 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-05-03T11:39:29.479 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-05-03T11:39:29.480 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-05-03T11:39:29.480 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-05-03T11:39:29.480 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-05-03T11:39:29.480 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-05-03T11:39:29.480 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-03T11:39:29.481 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-03T11:39:29.482 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-05-03T11:39:29.504 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-05-03T11:39:29.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-03T11:39:29.696 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-05-03T11:39:29.753 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-03T11:39:29.754 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-05-03T11:39:29.755 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-03T11:39:29.755 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-05-03T11:39:29.755 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-03T11:39:29.755 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-03T11:39:29.755 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-03T11:39:29.756 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-05-03T11:39:29.866 INFO:teuthology.dispatcher.supervisor:Running job 7256245 2023-05-03T11:39:29.867 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_suriarte@teuthology --archive /home/teuthworker/archive/suriarte-2023-04-27_20:11:15-rgw-wip-d4n-distro-default-smithi/7256245 --name suriarte-2023-04-27_20:11:15-rgw-wip-d4n-distro-default-smithi --description rgw/upgrade/{1-install/pacific/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/suriarte-2023-04-27_20:11:15-rgw-wip-d4n-distro-default-smithi/7256245/orig.config.yaml 2023-05-03T11:39:29.871 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/suriarte-2023-04-27_20:11:15-rgw-wip-d4n-distro-default-smithi/7256245 2023-05-03T11:39:29.871 INFO:teuthology.dispatcher.supervisor:Job PID: 29457 2023-05-03T11:39:29.872 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-05-03T23:40:27.989 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-05-03T23:40:28.146 INFO:teuthology.kill:Killing Pids: {29457} 2023-05-03T23:40:29.069 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-05-03T23:40:29.070 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-05-03T23:40:29.070 INFO:teuthology.misc:Compressing logs... 2023-05-03T23:40:29.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-05-03T23:40:29.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-03T23:40:29.792 INFO:teuthology.misc:Compressing logs... 2023-05-03T23:40:29.822 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-03T23:40:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-03T23:40:29.823 INFO:teuthology.orchestra.run.smithi116.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-03T23:40:29.831 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-03T23:40:29.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-03T23:40:29.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-03T23:40:29.865 INFO:teuthology.orchestra.run.smithi154.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-03T23:40:29.873 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-03T23:40:29.947 INFO:teuthology.misc:Compressing logs... 2023-05-03T23:40:29.975 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112078.log 2023-05-03T23:40:29.975 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112295.log 2023-05-03T23:40:29.975 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112078.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.101086.log 2023-05-03T23:40:29.976 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112078.log.gz 2023-05-03T23:40:29.976 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107863.log 2023-05-03T23:40:29.982 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112295.log.gz 2023-05-03T23:40:29.983 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.tmp-client.admin.101086.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-05-03T23:40:29.983 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.101086.log.gz 2023-05-03T23:40:29.983 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.107863.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-05-03T23:40:29.983 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107863.log.gz 2023-05-03T23:40:29.984 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111405.log 2023-05-03T23:40:29.984 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112978.log 2023-05-03T23:40:29.984 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112071.log 2023-05-03T23:40:29.984 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111405.log.gz 2023-05-03T23:40:29.985 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112978.log.gz 2023-05-03T23:40:29.985 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-05-03T23:40:29.985 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112057.log 2023-05-03T23:40:29.986 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112071.log.gz 2023-05-03T23:40:29.986 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-05-03T23:40:29.986 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112057.log: 87.9% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-05-03T23:40:29.986 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112476.log 2023-05-03T23:40:29.987 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112057.log.gz 2023-05-03T23:40:29.987 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112477.log 2023-05-03T23:40:29.987 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112476.log.gz 2023-05-03T23:40:29.987 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112471.log 2023-05-03T23:40:29.988 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111684.log 2023-05-03T23:40:29.988 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112477.log.gz 2023-05-03T23:40:29.988 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112471.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112471.log.gz--verbose 2023-05-03T23:40:29.988 INFO:teuthology.orchestra.run.smithi116.stderr:-- /var/log/ceph/ceph-client.admin.112929.log 2023-05-03T23:40:29.989 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111684.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-05-03T23:40:29.989 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111684.log.gz 2023-05-03T23:40:29.989 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111462.log 2023-05-03T23:40:29.989 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112929.log.gz 2023-05-03T23:40:29.989 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112029.log 2023-05-03T23:40:29.990 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111462.log.gz 2023-05-03T23:40:29.990 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112029.log.gz 2023-05-03T23:40:29.990 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112881.log 2023-05-03T23:40:29.990 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-03T23:40:29.990 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112881.log.gz 2023-05-03T23:40:29.994 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-03T23:40:29.994 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111356.log 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.111356.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111356.log.gz 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112085.log 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112085.log.gz 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107732.log 2023-05-03T23:40:29.995 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.107732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107732.log.gz 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112832.log 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112832.log.gz 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112473.log 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112473.log.gz 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111692.log 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111692.log.gz 2023-05-03T23:40:29.996 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-05-03T23:40:30.003 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-05-03T23:40:30.014 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111678.log 2023-05-03T23:40:30.026 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107404.log 2023-05-03T23:40:30.026 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111143.log 2023-05-03T23:40:30.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.1.log 2023-05-03T23:40:30.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107354.log 2023-05-03T23:40:30.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-05-03T23:40:30.028 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107404.log.gz 2023-05-03T23:40:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111143.log: /var/log/ceph/rgw.ceph.client.1.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111143.log.gz 2023-05-03T23:40:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107451.log 2023-05-03T23:40:30.028 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107354.log.gz 2023-05-03T23:40:30.029 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/rgw.ceph.client.1.log.gz 2023-05-03T23:40:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107146.log 2023-05-03T23:40:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107451.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-05-03T23:40:30.030 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107451.log.gz 2023-05-03T23:40:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107507.log 2023-05-03T23:40:30.030 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107146.log.gz 2023-05-03T23:40:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107306.log 2023-05-03T23:40:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107209.log 2023-05-03T23:40:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107507.log.gz 2023-05-03T23:40:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107306.log.gz 2023-05-03T23:40:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111049.log 2023-05-03T23:40:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-03T23:40:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107209.log.gz 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111049.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111049.log.gz 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107259.log 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-03T23:40:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107259.log.gz 2023-05-03T23:40:30.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-05-03T23:40:30.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-05-03T23:40:30.035 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111678.log.gz 2023-05-03T23:40:30.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-05-03T23:40:30.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111096.log 2023-05-03T23:40:30.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111096.log.gz 2023-05-03T23:40:30.036 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111002.log 2023-05-03T23:40:30.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111002.log.gz 2023-05-03T23:40:30.037 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111677.log 2023-05-03T23:40:30.052 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-03T23:40:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111677.log.gz 2023-05-03T23:40:30.055 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112472.log 2023-05-03T23:40:30.057 INFO:teuthology.orchestra.run.smithi116.stderr: 95.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-03T23:40:30.059 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112472.log.gz 2023-05-03T23:40:30.059 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112736.log 2023-05-03T23:40:30.059 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112736.log.gz 2023-05-03T23:40:30.060 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111693.log 2023-05-03T23:40:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111693.log.gz 2023-05-03T23:40:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111679.log 2023-05-03T23:40:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111679.log.gz 2023-05-03T23:40:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107356.log 2023-05-03T23:40:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.107356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107356.log.gz 2023-05-03T23:40:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112687.log 2023-05-03T23:40:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112687.log.gz 2023-05-03T23:40:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112038.log 2023-05-03T23:40:30.074 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112038.log.gz 2023-05-03T23:40:30.074 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112084.log 2023-05-03T23:40:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112084.log.gz 2023-05-03T23:40:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111691.log 2023-05-03T23:40:30.076 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111691.log.gz 2023-05-03T23:40:30.077 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111307.log 2023-05-03T23:40:30.078 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111307.log.gz 2023-05-03T23:40:30.078 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112470.log 2023-05-03T23:40:30.079 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112470.log.gz 2023-05-03T23:40:30.079 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112469.log 2023-05-03T23:40:30.086 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112469.log.gz 2023-05-03T23:40:30.086 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111189.log 2023-05-03T23:40:30.087 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111189.log.gz 2023-05-03T23:40:30.087 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112082.log 2023-05-03T23:40:30.087 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112082.log.gz 2023-05-03T23:40:30.088 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112785.log 2023-05-03T23:40:30.088 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112785.log.gz 2023-05-03T23:40:30.088 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111685.log 2023-05-03T23:40:30.089 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111685.log.gz 2023-05-03T23:40:30.089 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111258.log 2023-05-03T23:40:30.089 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111258.log.gz 2023-05-03T23:40:30.328 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-05-03T23:40:33.369 INFO:teuthology.orchestra.run.smithi116.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-05-03T23:40:39.486 INFO:teuthology.orchestra.run.smithi116.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-05-03T23:40:40.048 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-05-03T23:40:47.365 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-05-03T23:40:48.198 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-05-03T23:40:50.176 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-05-03T23:40:50.221 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-05-03T23:40:50.479 INFO:teuthology.orchestra.run.smithi116.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-05-03T23:40:51.709 INFO:teuthology.orchestra.run.smithi116.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-05-03T23:40:53.264 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-05-03T23:40:55.167 INFO:teuthology.orchestra.run.smithi116.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-05-03T23:40:58.275 INFO:teuthology.orchestra.run.smithi116.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-05-03T23:41:20.782 INFO:teuthology.kill:No teuthology processes running 2023-05-03T23:41:21.653 INFO:teuthology.kill:Nuking machines: ['smithi116', 'smithi154'] 2023-05-03T23:41:22.250 INFO:teuthology.kill:2023-05-03 23:41:22,250.250 INFO:teuthology.nuke:targets: 2023-05-03T23:41:22.251 INFO:teuthology.kill: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCji4QBLNmNqINRZ9rW8E0Iou9QfCDDefWUQ9fr7dMueD+JxHoramo/8o6e/AIDiQw/JcweMxgAal6WUmoTxu5CUWs84u7kTzfhBR2i3iW8m+v+BR5kh4txhnfQ5vSLf7sacA1s/68JNIHTidGxlx49PU4HhUE+RhsxVTvzQFoQmqGmWElff4GECBmE/g5cOwq6icjhVrz4f0VqMXCRPgC0waLSUUL1slmI4qrn+DLgJpJ0S44LDpj/SIlgdlLnhQkFZoq1jfoH/v5rEFvdAt6z6zVHddCnoe/FQ6LBsGFsber7K4s5PNCHeNLb+SqELpR4qIA4DS/UVD9RCecUbghJ82RUicC1AuhKf8xvp63Fk4Ovza0JCvWeqL2LTKlzh/oBAHMCPK+o7JuZ7DUp2pbaLiCrFCPfgGvtvRpyo7yiqMsokZ9j4YzBWTaRo6raWjcJhO8aAC8WxWhoUoTd51Mzrq+DXdct7fcsmMgTIAsYW318p+2On4WOtdoGMjwrmmc= 2023-05-03T23:41:22.252 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9IV6Yo492SQqFL6Gue9eoOXsY3CiHpscoixCQvJr7SCCDDBA7rMkn4NfcdIa4QpwoPb3ZjyK76kxvl9yzDlM= 2023-05-03T23:41:22.252 INFO:teuthology.kill:2023-05-03 23:41:22,250.250 INFO:teuthology.nuke:Checking targets against current locks 2023-05-03T23:41:22.303 INFO:teuthology.kill:2023-05-03 23:41:22,303.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-03T23:41:22.335 INFO:teuthology.kill:2023-05-03 23:41:22,335.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-03T23:41:22.373 INFO:teuthology.kill:2023-05-03 23:41:22,373.373 INFO:teuthology.orchestra.console:Power off smithi116 2023-05-03T23:41:22.412 INFO:teuthology.kill:2023-05-03 23:41:22,412.412 INFO:teuthology.orchestra.console:Power off smithi154 2023-05-03T23:41:30.777 INFO:teuthology.kill:2023-05-03 23:41:30,777.777 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-05-03T23:41:30.942 INFO:teuthology.kill:2023-05-03 23:41:30,941.941 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-05-03T23:41:34.867 INFO:teuthology.kill:2023-05-03 23:41:34,867.867 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-05-03T23:41:35.023 INFO:teuthology.kill:2023-05-03 23:41:35,023.023 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-05-03T23:43:35.406 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-05-03T23:43:35.513 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi154 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-03_22:10:48-fs-wip-yuri6-testing-2023-04-26-1247-reef-distro-default-smithi/7261766