2024-03-22T02:21:11.393 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-22T02:21:11.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:21:11.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f85d8187f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f85d91e7c10>, signals=[15])
2024-03-22T02:21:11.532 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2024-03-22T02:21:11.532 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2024-03-22T02:21:11.532 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-22T02:21:11.555 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2024-03-22T02:21:11.556 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2024-03-22T02:21:11.556 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-22T02:21:11.670 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10)
2024-03-22T02:21:11.701 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10)
2024-03-22T02:21:11.711 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream
2024-03-22T02:21:11.751 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream
2024-03-22T02:21:11.961 INFO:teuthology.orchestra.console.smithi105:Power off
2024-03-22T02:21:11.961 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-22T02:21:11.976 INFO:teuthology.orchestra.console.smithi177:Power off
2024-03-22T02:21:11.976 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-22T02:21:11.985 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2024-03-22T02:21:11.986 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:12.001 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2024-03-22T02:21:12.001 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:12.011 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-22T02:21:12.025 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-03-22T02:21:16.014 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:16.026 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:16.124 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-22T02:21:16.134 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-03-22T02:21:20.126 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:20.135 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:20.235 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-22T02:21:20.244 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-22T02:21:20.344 INFO:teuthology.orchestra.console.smithi177:Power off completed
2024-03-22T02:21:20.445 INFO:teuthology.orchestra.console.smithi177:Power on
2024-03-22T02:21:20.445 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-22T02:21:20.466 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2024-03-22T02:21:20.466 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:20.487 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-22T02:21:24.242 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:24.352 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-22T02:21:24.453 INFO:teuthology.orchestra.console.smithi105:Power off completed
2024-03-22T02:21:24.488 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:24.554 INFO:teuthology.orchestra.console.smithi105:Power on
2024-03-22T02:21:24.555 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-22T02:21:24.576 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2024-03-22T02:21:24.576 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:24.596 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-22T02:21:24.597 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-22T02:21:28.600 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:28.607 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T02:21:28.710 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-03-22T02:21:28.716 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-22T02:21:28.811 INFO:teuthology.orchestra.console.smithi177:Power on completed
2024-03-22T02:21:28.818 INFO:teuthology.orchestra.console.smithi105:Power on completed
2024-03-22T02:21:28.912 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2024-03-22T02:21:28.918 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2024-03-22T02:23:59.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:23:59.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:02.814 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:02.815 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:08.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:08.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:11.906 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:11.907 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:17.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:17.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:20.990 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:20.991 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:26.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:26.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:30.046 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:30.078 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:36.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:36.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:39.106 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:39.134 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:45.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:45.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:48.194 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:48.195 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:24:54.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:54.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:24:57.278 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-22T02:24:57.279 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-22T02:25:03.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:25:03.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:26:03.347 WARNING:teuthology.provision.fog.smithi177:timed out
2024-03-22T02:26:03.347 WARNING:teuthology.provision.fog.smithi105:timed out
2024-03-22T02:26:09.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:26:09.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:26:09.696 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-22T02:26:09.696 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-22T02:26:09.795 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-22T02:26:09.795 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-22T02:26:10.020 INFO:teuthology.provision.fog.smithi105:Node is ready
2024-03-22T02:26:10.020 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2024-03-22T02:26:10.035 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2024-03-22T02:26:10.035 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2024-03-22T02:26:10.091 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2024-03-22T02:26:10.092 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-22T02:26:10.108 INFO:teuthology.provision.fog.smithi177:Node is ready
2024-03-22T02:26:10.109 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2024-03-22T02:26:10.123 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2024-03-22T02:26:10.123 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2024-03-22T02:26:10.182 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2024-03-22T02:26:10.182 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-22T02:26:10.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2024-03-22T02:26:10.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2024-03-22T02:26:10.286 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2024-03-22T02:26:10.308 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2024-03-22T02:26:10.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2024-03-22T02:26:10.376 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-22T02:26:10.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2024-03-22T02:26:10.443 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-22T02:26:10.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-22T02:26:10.498 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-22T02:26:10.498 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-22T02:26:10.498 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-22T02:26:10.498 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-22T02:26:10.498 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-22T02:26:10.499 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T02:26:10.500 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2024-03-22T02:26:10.501 DEBUG:teuthology.parallel:result is None
2024-03-22T02:26:10.527 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-22T02:26:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-22T02:26:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T02:26:10.586 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2024-03-22T02:26:10.587 DEBUG:teuthology.parallel:result is None
2024-03-22T02:26:10.749 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2024-03-22T02:26:10.749 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-22T02:26:10.772 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2024-03-22T02:26:10.772 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-22T02:26:10.790 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2024-03-22T02:26:10.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-22T02:26:10.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:26:10.878 DEBUG:teuthology.orchestra.run.smithi105:> true
2024-03-22T02:26:10.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-22T02:26:10.945 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2024-03-22T02:26:10.999 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2024-03-22T02:26:10.999 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-22T02:26:11.053 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T02:26:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-22T02:26:11.055 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T02:26:11.055 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-22T02:26:11.081 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2024-03-22T02:26:11.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-22T02:26:11.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T02:26:11.217 DEBUG:teuthology.orchestra.run.smithi177:> true
2024-03-22T02:26:11.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-22T02:26:11.241 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2024-03-22T02:26:11.298 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2024-03-22T02:26:11.298 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-22T02:26:11.356 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-22T02:26:11.357 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T02:26:11.358 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-22T02:26:11.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:26:11.486 INFO:teuthology.dispatcher.supervisor:Running job 7615823
2024-03-22T02:26:11.486 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615823 --name pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615823/orig.config.yaml
2024-03-22T02:26:11.489 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615823
2024-03-22T02:26:11.490 INFO:teuthology.dispatcher.supervisor:Job PID: 1280452
2024-03-22T02:26:11.490 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-22T02:28:11.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:30:11.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:32:11.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:34:12.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:36:12.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:38:12.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:40:12.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:42:12.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:44:12.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:46:13.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:48:13.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:50:13.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:52:13.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:54:14.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:56:14.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T02:58:14.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:00:14.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:02:14.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:04:15.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:06:15.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:08:15.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:10:15.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:12:15.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:14:15.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:16:16.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:18:16.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:20:16.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:22:16.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:24:16.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:26:16.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:28:17.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:30:17.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:32:17.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:34:17.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:36:17.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:38:17.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:40:18.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:42:18.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:44:18.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:46:18.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:48:18.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:50:18.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:52:19.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:54:19.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:56:19.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T03:58:19.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:00:19.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:02:19.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:04:20.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:06:20.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:08:20.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:10:20.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:12:20.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:14:20.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:16:21.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:18:21.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:20:21.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:22:21.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:24:21.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:26:21.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:28:22.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:30:22.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:32:22.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:34:22.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:36:22.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:38:23.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:40:23.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:42:23.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:44:23.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:46:23.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:48:23.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:50:24.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:52:24.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:54:24.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:56:24.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T04:58:24.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:00:24.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:02:25.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:04:25.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:06:25.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:08:25.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:10:25.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:12:25.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:14:26.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:16:26.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:18:26.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:20:26.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:22:26.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:24:26.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:26:27.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:28:27.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:30:27.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:32:27.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:34:27.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:36:28.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:38:28.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:40:28.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:42:28.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:44:28.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:46:28.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:48:29.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:50:29.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:52:29.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:54:29.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:56:29.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T05:58:29.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:00:30.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:02:30.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:04:30.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:06:30.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:08:30.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:10:30.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T06:10:30.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1