2024-03-07T08:51:46.664 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T08:51:46.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T08:51:46.850 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc0a5e20f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc0a6e81c10>, signals=[15])
2024-03-07T08:51:46.851 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2024-03-07T08:51:46.851 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T08:51:46.851 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-03-07T08:51:46.873 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2024-03-07T08:51:46.873 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T08:51:46.873 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-03-07T08:51:46.897 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-03-07T08:51:46.897 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T08:51:46.898 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-07T08:51:46.991 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T08:51:47.016 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T08:51:47.038 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T08:51:47.042 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.stream
2024-03-07T08:51:47.064 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2024-03-07T08:51:47.089 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2024-03-07T08:51:47.373 INFO:teuthology.orchestra.console.smithi161:Power off
2024-03-07T08:51:47.373 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T08:51:47.388 INFO:teuthology.orchestra.console.smithi154:Power off
2024-03-07T08:51:47.388 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T08:51:47.399 INFO:teuthology.orchestra.console.smithi078:Power off
2024-03-07T08:51:47.399 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T08:51:47.408 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-03-07T08:51:47.409 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:47.417 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2024-03-07T08:51:47.417 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:47.427 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2024-03-07T08:51:47.427 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:47.436 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-07T08:51:47.442 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-03-07T08:51:47.459 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-03-07T08:51:51.440 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:51.448 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:51.460 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:51.550 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-07T08:51:51.557 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-03-07T08:51:51.569 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-03-07T08:51:55.552 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:55.559 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:55.570 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:55.662 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-07T08:51:55.668 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-07T08:51:55.679 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-03-07T08:51:55.763 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-03-07T08:51:55.768 INFO:teuthology.orchestra.console.smithi154:Power off completed
2024-03-07T08:51:55.864 INFO:teuthology.orchestra.console.smithi161:Power on
2024-03-07T08:51:55.864 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T08:51:55.873 INFO:teuthology.orchestra.console.smithi154:Power on
2024-03-07T08:51:55.873 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T08:51:55.894 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-03-07T08:51:55.895 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:55.903 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2024-03-07T08:51:55.904 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:55.917 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-07T08:51:55.926 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-07T08:51:59.680 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:59.789 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-03-07T08:51:59.890 INFO:teuthology.orchestra.console.smithi078:Power off completed
2024-03-07T08:51:59.919 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:59.927 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:51:59.991 INFO:teuthology.orchestra.console.smithi078:Power on
2024-03-07T08:51:59.991 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T08:52:00.013 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2024-03-07T08:52:00.014 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:52:00.029 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-07T08:52:00.034 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-03-07T08:52:00.038 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-07T08:52:04.032 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:52:04.039 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:52:04.046 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T08:52:04.142 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-07T08:52:04.148 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-03-07T08:52:04.155 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-03-07T08:52:04.243 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-03-07T08:52:04.249 INFO:teuthology.orchestra.console.smithi078:Power on completed
2024-03-07T08:52:04.255 INFO:teuthology.orchestra.console.smithi154:Power on completed
2024-03-07T08:52:04.345 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-03-07T08:52:04.349 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2024-03-07T08:52:04.355 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2024-03-07T08:54:50.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:54:50.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:54:50.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:54:53.340 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:54:53.341 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:54:53.341 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:54:59.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:54:59.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:54:59.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:02.396 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:02.396 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:02.432 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:55:08.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:08.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:08.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:11.452 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:11.484 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:55:11.484 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:17.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:17.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:17.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:20.508 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:20.540 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:55:20.540 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:26.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:26.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:26.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:29.568 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:29.596 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:55:29.596 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:35.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:35.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:35.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:38.652 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:38.652 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-03-07T08:55:38.653 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:44.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:44.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:44.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:47.708 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-07T08:55:47.740 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-07T08:55:53.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:55:53.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:56:44.696 WARNING:teuthology.provision.fog.smithi078:timed out
2024-03-07T08:56:50.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:56:50.963 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T08:56:50.964 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T08:56:51.230 INFO:teuthology.provision.fog.smithi078:Node is ready
2024-03-07T08:56:51.230 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2024-03-07T08:56:51.249 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2024-03-07T08:56:51.249 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts
2024-03-07T08:56:51.310 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2024-03-07T08:56:51.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-03-07T08:56:51.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts
2024-03-07T08:56:51.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts
2024-03-07T08:56:51.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname
2024-03-07T08:56:51.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-03-07T08:56:51.655 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:56:51.713 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:56:51.714 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:56:51.714 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:56:51.714 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2024-03-07T08:56:51.715 DEBUG:teuthology.parallel:result is None
2024-03-07T08:56:53.717 WARNING:teuthology.provision.fog.smithi154:timed out
2024-03-07T08:56:53.743 WARNING:teuthology.provision.fog.smithi161:timed out
2024-03-07T08:56:59.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:56:59.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:56:59.984 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T08:56:59.985 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T08:57:00.010 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T08:57:00.010 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T08:57:00.212 INFO:teuthology.provision.fog.smithi154:Node is ready
2024-03-07T08:57:00.212 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2024-03-07T08:57:00.230 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2024-03-07T08:57:00.231 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2024-03-07T08:57:00.243 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-03-07T08:57:00.243 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-03-07T08:57:00.263 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-03-07T08:57:00.263 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-03-07T08:57:00.289 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2024-03-07T08:57:00.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-03-07T08:57:00.324 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-03-07T08:57:00.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-07T08:57:00.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2024-03-07T08:57:00.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2024-03-07T08:57:00.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-03-07T08:57:00.461 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-03-07T08:57:00.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2024-03-07T08:57:00.530 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-03-07T08:57:00.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-03-07T08:57:00.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-07T08:57:00.633 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-03-07T08:57:00.667 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-07T08:57:00.690 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:57:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:57:00.692 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2024-03-07T08:57:00.692 DEBUG:teuthology.parallel:result is None
2024-03-07T08:57:00.725 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-07T08:57:00.725 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:57:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:57:00.726 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-03-07T08:57:00.727 DEBUG:teuthology.parallel:result is None
2024-03-07T08:57:00.910 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2024-03-07T08:57:00.911 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T08:57:00.936 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2024-03-07T08:57:00.936 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T08:57:00.961 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-03-07T08:57:00.961 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T08:57:00.979 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2024-03-07T08:57:00.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-03-07T08:57:00.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:57:01.052 DEBUG:teuthology.orchestra.run.smithi078:> true
2024-03-07T08:57:01.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-03-07T08:57:01.125 DEBUG:teuthology.orchestra.run.smithi078:> uname -m
2024-03-07T08:57:01.186 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2024-03-07T08:57:01.187 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:57:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:57:01.249 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:57:01.249 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:57:01.249 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:57:01.249 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-03-07T08:57:01.270 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2024-03-07T08:57:01.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-03-07T08:57:01.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:57:01.342 DEBUG:teuthology.orchestra.run.smithi154:> true
2024-03-07T08:57:01.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-03-07T08:57:01.410 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2024-03-07T08:57:01.469 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2024-03-07T08:57:01.469 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-03-07T08:57:01.526 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:57:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:57:01.528 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-03-07T08:57:01.553 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-03-07T08:57:01.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-07T08:57:01.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T08:57:01.623 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-03-07T08:57:01.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-07T08:57:01.691 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-03-07T08:57:01.750 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-03-07T08:57:01.751 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-07T08:57:01.809 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-07T08:57:01.809 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T08:57:01.810 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T08:57:01.811 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-07T08:57:01.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T08:57:01.928 INFO:teuthology.dispatcher.supervisor:Running job 7583996
2024-03-07T08:57:01.928 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583996 --name leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583996/orig.config.yaml
2024-03-07T08:57:01.931 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583996
2024-03-07T08:57:01.932 INFO:teuthology.dispatcher.supervisor:Job PID: 3404457
2024-03-07T08:57:01.932 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T08:59:02.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:01:02.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:03:02.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:05:02.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:07:02.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:09:02.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:11:03.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:13:03.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:15:03.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:17:03.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:19:03.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:21:03.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:23:04.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:25:04.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T09:25:04.314 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1