2024-02-06T07:32:46.598 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-06T07:32:46.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:32:46.781 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa3ab6caf10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa3ac62cc10>, signals=[15])
2024-02-06T07:32:46.782 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2024-02-06T07:32:46.782 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2024-02-06T07:32:46.782 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2024-02-06T07:32:46.805 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2024-02-06T07:32:46.805 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2024-02-06T07:32:46.805 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-02-06T07:32:46.830 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-02-06T07:32:46.830 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-02-06T07:32:46.830 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-02-06T07:32:46.924 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3)
2024-02-06T07:32:46.958 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3)
2024-02-06T07:32:46.962 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3)
2024-02-06T07:32:46.982 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream
2024-02-06T07:32:47.004 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2024-02-06T07:32:47.007 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2024-02-06T07:32:47.207 INFO:teuthology.orchestra.console.smithi112:Power off
2024-02-06T07:32:47.207 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-06T07:32:47.221 INFO:teuthology.orchestra.console.smithi099:Power off
2024-02-06T07:32:47.222 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-06T07:32:47.233 INFO:teuthology.orchestra.console.smithi084:Power off
2024-02-06T07:32:47.234 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-06T07:32:47.242 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-02-06T07:32:47.242 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:47.250 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-02-06T07:32:47.251 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:47.260 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off
2024-02-06T07:32:47.260 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:47.268 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-02-06T07:32:47.275 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-06T07:32:47.282 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2024-02-06T07:32:51.272 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:51.280 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:51.287 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:51.383 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-02-06T07:32:51.389 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-06T07:32:51.396 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2024-02-06T07:32:55.388 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:55.395 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:55.403 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:55.498 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-02-06T07:32:55.504 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-02-06T07:32:55.511 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-02-06T07:32:55.606 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-02-06T07:32:55.612 INFO:teuthology.orchestra.console.smithi084:Power off completed
2024-02-06T07:32:55.707 INFO:teuthology.orchestra.console.smithi099:Power on
2024-02-06T07:32:55.707 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-06T07:32:55.716 INFO:teuthology.orchestra.console.smithi084:Power on
2024-02-06T07:32:55.716 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-06T07:32:55.733 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2024-02-06T07:32:55.733 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:55.742 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On
2024-02-06T07:32:55.742 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:55.755 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-02-06T07:32:55.764 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-02-06T07:32:59.502 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:59.612 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-02-06T07:32:59.712 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-02-06T07:32:59.756 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:59.765 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:59.813 INFO:teuthology.orchestra.console.smithi112:Power on
2024-02-06T07:32:59.814 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-06T07:32:59.836 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-02-06T07:32:59.836 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:32:59.857 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-02-06T07:32:59.865 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-02-06T07:32:59.872 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2024-02-06T07:32:59.973 INFO:teuthology.orchestra.console.smithi084:Power on completed
2024-02-06T07:33:00.074 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2024-02-06T07:33:03.861 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:33:03.869 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-06T07:33:03.971 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-02-06T07:33:03.980 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-06T07:33:04.073 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-02-06T07:33:04.081 INFO:teuthology.orchestra.console.smithi099:Power on completed
2024-02-06T07:33:04.174 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-02-06T07:33:04.182 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2024-02-06T07:35:46.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:35:49.052 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:35:50.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:35:50.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:35:53.148 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:35:53.148 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:35:55.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:35:58.108 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:35:59.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:35:59.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:02.208 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:36:02.208 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:36:04.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:07.168 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:36:08.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:08.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:11.296 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:36:11.296 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:36:13.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:16.220 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:36:17.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:17.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:20.380 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:36:20.380 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:36:22.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:25.279 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:36:26.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:26.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:29.436 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:36:29.436 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:36:31.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:34.364 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:36:35.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:35.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:38.496 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-06T07:36:38.496 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-02-06T07:36:40.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:43.424 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-02-06T07:36:44.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:44.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:36:49.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:44.554 WARNING:teuthology.provision.fog.smithi099:timed out
2024-02-06T07:37:44.556 WARNING:teuthology.provision.fog.smithi112:timed out
2024-02-06T07:37:49.437 WARNING:teuthology.provision.fog.smithi084:timed out
2024-02-06T07:37:50.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:50.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:50.814 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-06T07:37:50.815 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-06T07:37:50.900 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-06T07:37:50.900 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-06T07:37:51.029 INFO:teuthology.provision.fog.smithi099:Node is ready
2024-02-06T07:37:51.029 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2024-02-06T07:37:51.088 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2024-02-06T07:37:51.088 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2024-02-06T07:37:51.146 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2024-02-06T07:37:51.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-02-06T07:37:51.150 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-02-06T07:37:51.150 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-02-06T07:37:51.169 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-02-06T07:37:51.169 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-02-06T07:37:51.228 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-02-06T07:37:51.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-02-06T07:37:51.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2024-02-06T07:37:51.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2024-02-06T07:37:51.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-02-06T07:37:51.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-02-06T07:37:51.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2024-02-06T07:37:51.424 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-02-06T07:37:51.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-02-06T07:37:51.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-02-06T07:37:51.494 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:51.554 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:51.554 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2024-02-06T07:37:51.556 DEBUG:teuthology.parallel:result is None
2024-02-06T07:37:51.557 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:51.615 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:51.616 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:51.616 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:51.616 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:51.616 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:51.616 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:51.616 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-02-06T07:37:51.617 DEBUG:teuthology.parallel:result is None
2024-02-06T07:37:55.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:55.687 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-06T07:37:55.687 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-06T07:37:55.939 INFO:teuthology.provision.fog.smithi084:Node is ready
2024-02-06T07:37:55.939 DEBUG:teuthology.orchestra.run.smithi084:> hostname
2024-02-06T07:37:55.958 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com
2024-02-06T07:37:55.959 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts
2024-02-06T07:37:56.018 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084
2024-02-06T07:37:56.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2024-02-06T07:37:56.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts
2024-02-06T07:37:56.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts
2024-02-06T07:37:56.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname
2024-02-06T07:37:56.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2024-02-06T07:37:56.361 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2024-02-06T07:37:56.419 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:56.420 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:56.421 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2024-02-06T07:37:56.421 DEBUG:teuthology.parallel:result is None
2024-02-06T07:37:56.603 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2024-02-06T07:37:56.604 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-06T07:37:56.626 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2024-02-06T07:37:56.626 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-06T07:37:56.645 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2024-02-06T07:37:56.646 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-06T07:37:56.660 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2024-02-06T07:37:56.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2024-02-06T07:37:56.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:56.733 DEBUG:teuthology.orchestra.run.smithi084:> true
2024-02-06T07:37:56.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com'
2024-02-06T07:37:56.802 DEBUG:teuthology.orchestra.run.smithi084:> uname -m
2024-02-06T07:37:56.859 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2024-02-06T07:37:56.859 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:56.917 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:56.918 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2024-02-06T07:37:56.934 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2024-02-06T07:37:56.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-02-06T07:37:56.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:57.008 DEBUG:teuthology.orchestra.run.smithi099:> true
2024-02-06T07:37:57.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-02-06T07:37:57.081 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2024-02-06T07:37:57.141 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2024-02-06T07:37:57.141 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-02-06T07:37:57.201 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:57.203 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-02-06T07:37:57.226 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2024-02-06T07:37:57.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-02-06T07:37:57.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-06T07:37:57.296 DEBUG:teuthology.orchestra.run.smithi112:> true
2024-02-06T07:37:57.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-02-06T07:37:57.369 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2024-02-06T07:37:57.428 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2024-02-06T07:37:57.428 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-02-06T07:37:57.487 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-06T07:37:57.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-06T07:37:57.489 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-02-06T07:37:57.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:37:57.603 INFO:teuthology.dispatcher.supervisor:Running job 7547424
2024-02-06T07:37:57.603 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-05_19:32:33-rados-wip-yuri4-testing-2024-02-05-0849-distro-default-smithi/7547424 --name yuriw-2024-02-05_19:32:33-rados-wip-yuri4-testing-2024-02-05-0849-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-02-05_19:32:33-rados-wip-yuri4-testing-2024-02-05-0849-distro-default-smithi/7547424/orig.config.yaml
2024-02-06T07:37:57.606 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-05_19:32:33-rados-wip-yuri4-testing-2024-02-05-0849-distro-default-smithi/7547424
2024-02-06T07:37:57.607 INFO:teuthology.dispatcher.supervisor:Job PID: 1255512
2024-02-06T07:37:57.607 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-06T07:39:57.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:41:57.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:43:58.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:45:58.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:47:58.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:49:58.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:51:58.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:53:58.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:55:59.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:57:59.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T07:59:59.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:01:59.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:03:59.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:05:59.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:08:00.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:10:00.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:12:00.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:14:00.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:16:00.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-06T08:16:00.992 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1