2024-03-31T01:37:31.019 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T01:37:31.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:37:31.185 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa55f6fc10>, signals=[15]) 2024-03-31T01:37:31.185 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2024-03-31T01:37:31.185 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T01:37:31.185 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-31T01:37:31.207 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-03-31T01:37:31.207 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T01:37:31.208 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-03-31T01:37:31.223 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2024-03-31T01:37:31.223 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T01:37:31.223 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-03-31T01:37:31.315 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T01:37:31.336 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T01:37:31.368 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T01:37:31.371 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2024-03-31T01:37:31.376 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream 2024-03-31T01:37:31.413 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2024-03-31T01:37:31.568 INFO:teuthology.orchestra.console.smithi156:Power off 2024-03-31T01:37:31.568 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T01:37:31.582 INFO:teuthology.orchestra.console.smithi019:Power off 2024-03-31T01:37:31.582 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T01:37:31.593 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-03-31T01:37:31.593 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.602 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-03-31T01:37:31.602 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.614 INFO:teuthology.orchestra.console.smithi192:Power off 2024-03-31T01:37:31.614 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T01:37:31.623 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-31T01:37:31.623 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-03-31T01:37:31.635 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2024-03-31T01:37:31.635 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.654 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-03-31T01:37:31.724 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-03-31T01:37:31.726 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-03-31T01:37:31.756 INFO:teuthology.orchestra.console.smithi192:Power off completed 2024-03-31T01:37:31.826 INFO:teuthology.orchestra.console.smithi019:Power on 2024-03-31T01:37:31.826 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T01:37:31.833 INFO:teuthology.orchestra.console.smithi156:Power on 2024-03-31T01:37:31.833 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T01:37:31.850 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2024-03-31T01:37:31.850 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.858 INFO:teuthology.orchestra.console.smithi192:Power on 2024-03-31T01:37:31.858 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T01:37:31.867 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-03-31T01:37:31.867 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.875 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-31T01:37:31.880 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2024-03-31T01:37:31.881 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:31.888 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-03-31T01:37:31.901 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-03-31T01:37:35.878 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:35.889 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:35.902 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:35.987 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-31T01:37:35.996 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-03-31T01:37:36.011 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-03-31T01:37:39.990 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:39.997 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:40.012 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T01:37:40.100 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-31T01:37:40.106 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-03-31T01:37:40.120 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-03-31T01:37:40.201 INFO:teuthology.orchestra.console.smithi019:Power on completed 2024-03-31T01:37:40.206 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-03-31T01:37:40.220 INFO:teuthology.orchestra.console.smithi192:Power on completed 2024-03-31T01:37:40.301 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2024-03-31T01:37:40.307 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-03-31T01:37:40.322 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2024-03-31T01:40:11.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:11.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:14.398 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:40:14.399 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-31T01:40:20.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:20.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:23.486 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:40:23.487 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-31T01:40:26.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:29.470 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:40:29.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:29.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:32.542 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:40:32.542 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-31T01:40:35.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:38.526 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:40:38.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:38.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:41.598 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:40:41.599 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-31T01:40:44.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:47.582 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:40:47.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:47.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:50.654 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:40:50.655 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-31T01:40:53.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:56.638 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:40:56.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:56.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:40:59.710 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-03-31T01:41:02.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:41:05.694 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:41:05.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:41:11.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:41:14.750 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:41:20.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:41:23.838 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-03-31T01:41:29.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:41:56.687 WARNING:teuthology.provision.fog.smithi019:timed out 2024-03-31T01:42:02.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:02.941 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T01:42:02.942 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T01:42:03.274 INFO:teuthology.provision.fog.smithi019:Node is ready 2024-03-31T01:42:03.275 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2024-03-31T01:42:03.290 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2024-03-31T01:42:03.290 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2024-03-31T01:42:03.345 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2024-03-31T01:42:03.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-03-31T01:42:03.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2024-03-31T01:42:03.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2024-03-31T01:42:03.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2024-03-31T01:42:03.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-03-31T01:42:03.706 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-31T01:42:03.761 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:03.762 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:03.763 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2024-03-31T01:42:03.764 DEBUG:teuthology.parallel:result is None 2024-03-31T01:42:05.715 WARNING:teuthology.provision.fog.smithi192:timed out 2024-03-31T01:42:11.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:11.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T01:42:11.953 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T01:42:12.267 INFO:teuthology.provision.fog.smithi192:Node is ready 2024-03-31T01:42:12.267 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2024-03-31T01:42:12.281 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2024-03-31T01:42:12.282 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2024-03-31T01:42:12.336 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2024-03-31T01:42:12.337 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-03-31T01:42:12.434 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2024-03-31T01:42:12.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2024-03-31T01:42:12.528 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2024-03-31T01:42:12.595 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-03-31T01:42:12.661 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-03-31T01:42:12.715 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:12.716 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:12.717 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2024-03-31T01:42:12.717 DEBUG:teuthology.parallel:result is None 2024-03-31T01:42:29.847 WARNING:teuthology.provision.fog.smithi156:timed out 2024-03-31T01:42:35.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:36.163 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T01:42:36.164 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T01:42:36.477 INFO:teuthology.provision.fog.smithi156:Node is ready 2024-03-31T01:42:36.477 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2024-03-31T01:42:36.492 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2024-03-31T01:42:36.492 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2024-03-31T01:42:36.548 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2024-03-31T01:42:36.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-03-31T01:42:36.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2024-03-31T01:42:36.685 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2024-03-31T01:42:36.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2024-03-31T01:42:36.820 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-03-31T01:42:36.887 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-03-31T01:42:36.942 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:36.943 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:36.943 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2024-03-31T01:42:36.944 DEBUG:teuthology.parallel:result is None 2024-03-31T01:42:37.153 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2024-03-31T01:42:37.154 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T01:42:37.176 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2024-03-31T01:42:37.176 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T01:42:37.201 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2024-03-31T01:42:37.201 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T01:42:37.218 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2024-03-31T01:42:37.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-31T01:42:37.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:37.318 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-31T01:42:37.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-31T01:42:37.496 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-03-31T01:42:37.550 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-03-31T01:42:37.551 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-31T01:42:37.605 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-31T01:42:37.605 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-31T01:42:37.605 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:37.606 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:37.607 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-31T01:42:37.627 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2024-03-31T01:42:37.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-03-31T01:42:37.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:37.713 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-03-31T01:42:37.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-03-31T01:42:37.782 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-03-31T01:42:37.836 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-03-31T01:42:37.837 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-03-31T01:42:37.891 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-03-31T01:42:37.891 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:37.892 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:37.893 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-03-31T01:42:37.910 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2024-03-31T01:42:37.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-03-31T01:42:37.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T01:42:37.998 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-03-31T01:42:38.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-03-31T01:42:38.168 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-03-31T01:42:38.222 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-03-31T01:42:38.222 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-03-31T01:42:38.276 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T01:42:38.277 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T01:42:38.278 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-03-31T01:42:38.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:42:38.413 INFO:teuthology.dispatcher.supervisor:Running job 7631037 2024-03-31T01:42:38.413 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631037 --name mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631037/orig.config.yaml 2024-03-31T01:42:38.416 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631037 2024-03-31T01:42:38.416 INFO:teuthology.dispatcher.supervisor:Job PID: 1824559 2024-03-31T01:42:38.416 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-31T01:44:38.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:46:38.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:48:38.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:50:39.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:52:39.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:54:39.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:56:39.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:58:39.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:00:39.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:02:40.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:04:40.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:06:40.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:08:40.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:10:40.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:12:41.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:14:41.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:16:41.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:18:41.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:20:41.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:22:41.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:24:42.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:26:42.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:26:42.324 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1