2024-01-31T04:39:59.385 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-01-31T04:39:59.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:39:59.547 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f60fb77ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f60fc725c10>, signals=[15])
2024-01-31T04:39:59.548 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-01-31T04:39:59.548 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-01-31T04:39:59.548 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-01-31T04:39:59.567 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-01-31T04:39:59.567 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-01-31T04:39:59.567 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-31T04:39:59.591 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2024-01-31T04:39:59.591 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2024-01-31T04:39:59.591 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2024-01-31T04:39:59.663 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10)
2024-01-31T04:39:59.697 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10)
2024-01-31T04:39:59.710 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream
2024-01-31T04:39:59.717 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10)
2024-01-31T04:39:59.743 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream
2024-01-31T04:39:59.753 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream
2024-01-31T04:39:59.953 INFO:teuthology.orchestra.console.smithi026:Power off
2024-01-31T04:39:59.953 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-31T04:39:59.969 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-31T04:39:59.969 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-31T04:39:59.984 INFO:teuthology.orchestra.console.smithi125:Power off
2024-01-31T04:39:59.984 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-31T04:39:59.992 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-01-31T04:39:59.992 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:39:59.999 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-31T04:39:59.999 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:00.007 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2024-01-31T04:40:00.008 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:00.015 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-31T04:40:00.021 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-31T04:40:00.031 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-01-31T04:40:00.117 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-01-31T04:40:00.121 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-31T04:40:00.133 INFO:teuthology.orchestra.console.smithi125:Power off completed
2024-01-31T04:40:00.218 INFO:teuthology.orchestra.console.smithi026:Power on
2024-01-31T04:40:00.218 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-31T04:40:00.228 INFO:teuthology.orchestra.console.smithi113:Power on
2024-01-31T04:40:00.229 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-31T04:40:00.234 INFO:teuthology.orchestra.console.smithi125:Power on
2024-01-31T04:40:00.235 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-31T04:40:00.242 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-01-31T04:40:00.243 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:00.252 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-01-31T04:40:00.253 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:00.260 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2024-01-31T04:40:00.260 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:00.267 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-31T04:40:00.272 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-31T04:40:00.279 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-01-31T04:40:04.268 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:04.274 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:04.281 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:04.377 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-01-31T04:40:04.383 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-01-31T04:40:04.388 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2024-01-31T04:40:04.484 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-01-31T04:40:04.584 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-01-31T04:40:08.382 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:08.389 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-31T04:40:08.490 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-01-31T04:40:08.498 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2024-01-31T04:40:08.591 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-01-31T04:40:08.599 INFO:teuthology.orchestra.console.smithi125:Power on completed
2024-01-31T04:40:08.692 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-01-31T04:40:08.699 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2024-01-31T04:42:25.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:42:28.092 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-31T04:42:34.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:42:37.152 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-31T04:42:43.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:42:46.236 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-31T04:42:52.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:42:55.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:42:55.292 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-31T04:42:58.300 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-01-31T04:43:01.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:04.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:04.348 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-01-31T04:43:07.356 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-01-31T04:43:10.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:13.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:16.412 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-01-31T04:43:21.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:22.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:24.572 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:43:25.468 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-01-31T04:43:30.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:31.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:33.628 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:43:34.524 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2024-01-31T04:43:39.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:40.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:42.716 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:43:48.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:43:51.772 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:43:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:00.828 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:44:06.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:09.884 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:44:10.355 WARNING:teuthology.provision.fog.smithi026:timed out
2024-01-31T04:44:15.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:16.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:16.691 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-31T04:44:16.691 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-31T04:44:17.014 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-01-31T04:44:17.014 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-01-31T04:44:17.029 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-01-31T04:44:17.029 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-01-31T04:44:17.084 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-01-31T04:44:17.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-01-31T04:44:17.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-01-31T04:44:17.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-01-31T04:44:17.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-01-31T04:44:17.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-01-31T04:44:17.447 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-01-31T04:44:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-01-31T04:44:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-01-31T04:44:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-01-31T04:44:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:44:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:44:17.504 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-01-31T04:44:17.506 DEBUG:teuthology.parallel:result is None
2024-01-31T04:44:18.972 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:44:24.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:28.028 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-31T04:44:34.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:40.534 WARNING:teuthology.provision.fog.smithi125:timed out
2024-01-31T04:44:46.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:44:46.845 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-31T04:44:46.845 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-31T04:44:47.208 INFO:teuthology.provision.fog.smithi125:Node is ready
2024-01-31T04:44:47.208 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2024-01-31T04:44:47.224 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2024-01-31T04:44:47.225 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2024-01-31T04:44:47.282 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2024-01-31T04:44:47.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2024-01-31T04:44:47.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2024-01-31T04:44:47.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2024-01-31T04:44:47.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2024-01-31T04:44:47.562 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2024-01-31T04:44:47.634 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2024-01-31T04:44:47.691 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:44:47.692 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:44:47.692 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:44:47.692 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:44:47.692 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:44:47.692 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:44:47.692 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2024-01-31T04:44:47.693 DEBUG:teuthology.parallel:result is None
2024-01-31T04:45:05.710 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-31T04:45:05.710 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-31T04:45:30.799 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-01-31T04:45:30.800 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-01-31T04:45:30.817 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-01-31T04:45:30.817 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-01-31T04:45:30.873 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-01-31T04:45:30.873 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-31T04:45:31.012 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-01-31T04:45:31.040 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-01-31T04:45:31.108 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-01-31T04:45:31.176 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-31T04:45:31.243 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-31T04:45:31.298 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:45:31.299 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:45:31.299 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:45:31.299 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:45:31.299 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:45:31.299 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:45:31.299 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-01-31T04:45:31.300 DEBUG:teuthology.parallel:result is None
2024-01-31T04:45:31.545 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-01-31T04:45:31.545 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-31T04:45:31.569 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-01-31T04:45:31.569 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-31T04:45:31.594 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2024-01-31T04:45:31.594 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-31T04:45:31.612 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-01-31T04:45:31.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-01-31T04:45:31.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:45:31.715 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-01-31T04:45:31.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-01-31T04:45:31.902 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-01-31T04:45:31.956 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-01-31T04:45:31.957 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:45:32.012 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:45:32.013 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:45:32.013 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:45:32.013 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:45:32.013 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:45:32.013 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-01-31T04:45:32.036 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-01-31T04:45:32.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-31T04:45:32.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:45:32.124 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-01-31T04:45:32.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-31T04:45:32.191 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-01-31T04:45:32.246 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-01-31T04:45:32.247 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:45:32.302 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:45:32.303 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:45:32.303 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-31T04:45:32.319 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2024-01-31T04:45:32.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2024-01-31T04:45:32.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-31T04:45:32.409 DEBUG:teuthology.orchestra.run.smithi125:> true
2024-01-31T04:45:32.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2024-01-31T04:45:32.574 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2024-01-31T04:45:32.628 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2024-01-31T04:45:32.628 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2024-01-31T04:45:32.683 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2024-01-31T04:45:32.683 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2024-01-31T04:45:32.683 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2024-01-31T04:45:32.683 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-31T04:45:32.684 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-31T04:45:32.685 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2024-01-31T04:45:32.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:45:32.794 INFO:teuthology.dispatcher.supervisor:Running job 7539467
2024-01-31T04:45:32.794 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539467 --name vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539467/orig.config.yaml
2024-01-31T04:45:32.798 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539467
2024-01-31T04:45:32.798 INFO:teuthology.dispatcher.supervisor:Job PID: 1135467
2024-01-31T04:45:32.798 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-31T04:47:32.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:49:33.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:51:33.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:53:33.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:55:33.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:57:33.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T04:59:33.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:01:34.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:03:34.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:05:34.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:07:34.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:09:34.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:11:34.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:13:35.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:15:35.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:17:35.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:19:35.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:21:35.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:23:35.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:25:36.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:27:36.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:29:36.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:31:36.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:33:36.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-31T05:33:36.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1