2023-11-28T13:25:50.178 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T13:25:50.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:25:50.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff7189e5dc0>, signals=[15]) 2023-11-28T13:25:50.357 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-11-28T13:25:50.357 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:25:50.357 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-11-28T13:25:50.399 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-11-28T13:25:50.400 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:25:50.400 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-28T13:25:50.423 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-11-28T13:25:50.424 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:25:50.424 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-11-28T13:25:50.533 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:25:50.537 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:25:50.566 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:25:50.571 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.6 2023-11-28T13:25:50.579 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6 2023-11-28T13:25:50.603 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-11-28T13:25:50.797 INFO:teuthology.orchestra.console.smithi092:Power off 2023-11-28T13:25:50.797 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:25:50.815 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-28T13:25:50.815 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:25:50.832 INFO:teuthology.orchestra.console.smithi169:Power off 2023-11-28T13:25:50.833 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:25:50.840 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-11-28T13:25:50.840 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:50.848 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-28T13:25:50.849 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:50.857 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-11-28T13:25:50.857 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:50.865 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-28T13:25:50.869 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-28T13:25:50.879 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-11-28T13:25:54.866 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:54.873 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:54.880 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:54.975 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-28T13:25:54.982 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-28T13:25:54.989 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-11-28T13:25:58.978 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:58.987 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:58.995 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:25:59.089 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-28T13:25:59.097 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-28T13:25:59.103 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-11-28T13:26:03.094 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.101 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.108 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.203 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-28T13:26:03.210 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-28T13:26:03.218 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-11-28T13:26:03.304 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-11-28T13:26:03.311 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-28T13:26:03.318 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-11-28T13:26:03.406 INFO:teuthology.orchestra.console.smithi092:Power on 2023-11-28T13:26:03.406 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:26:03.414 INFO:teuthology.orchestra.console.smithi112:Power on 2023-11-28T13:26:03.415 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:26:03.422 INFO:teuthology.orchestra.console.smithi169:Power on 2023-11-28T13:26:03.422 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:26:03.432 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-11-28T13:26:03.432 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.441 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-11-28T13:26:03.442 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.452 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-11-28T13:26:03.452 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:03.464 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-28T13:26:03.465 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-28T13:26:03.478 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-11-28T13:26:07.466 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:07.473 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:07.479 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:07.575 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-28T13:26:07.581 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-28T13:26:07.588 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-11-28T13:26:07.676 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-11-28T13:26:07.688 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-11-28T13:26:07.777 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-11-28T13:26:07.790 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-11-28T13:26:11.583 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:26:11.694 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-28T13:26:11.795 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-11-28T13:26:11.895 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-11-28T13:28:53.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:28:53.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:28:56.773 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:28:56.773 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-28T13:28:57.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:00.834 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:02.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:02.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:05.830 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-28T13:29:05.830 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:06.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:09.894 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:11.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:11.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:14.918 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-28T13:29:14.919 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:15.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:18.978 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:20.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:20.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:24.002 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:24.003 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-28T13:29:24.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:28.034 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:30.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:30.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:33.058 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-28T13:29:33.062 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:34.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:37.090 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:39.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:39.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:42.114 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:43.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:46.150 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-28T13:29:48.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:51.170 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:29:52.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:29:57.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:15.526 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:30:21.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:24.610 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:30:30.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:33.666 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-11-28T13:30:39.070 WARNING:teuthology.provision.fog.smithi112:timed out 2023-11-28T13:30:39.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:39.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:30:39.981 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:30:40.268 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-11-28T13:30:40.268 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-11-28T13:30:40.285 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-11-28T13:30:40.285 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-11-28T13:30:40.342 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-11-28T13:30:40.344 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-11-28T13:30:40.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-11-28T13:30:40.504 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-11-28T13:30:40.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-11-28T13:30:40.638 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-11-28T13:30:40.704 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-11-28T13:30:40.761 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:30:40.762 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:30:40.762 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-11-28T13:30:40.762 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-11-28T13:30:40.762 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-11-28T13:30:40.763 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:30:40.764 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:30:40.764 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:30:40.765 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:30:40.766 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-11-28T13:30:40.768 DEBUG:teuthology.parallel:result is None 2023-11-28T13:30:45.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:45.418 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:30:45.418 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:30:45.684 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-11-28T13:30:45.684 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-11-28T13:30:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-11-28T13:30:45.701 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-11-28T13:30:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-11-28T13:30:45.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-28T13:30:45.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-11-28T13:30:45.899 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-11-28T13:30:45.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-11-28T13:30:46.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-28T13:30:46.101 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-28T13:30:46.157 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:30:46.158 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:30:46.159 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:30:46.159 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-11-28T13:30:46.160 DEBUG:teuthology.parallel:result is None 2023-11-28T13:30:52.158 WARNING:teuthology.provision.fog.smithi092:timed out 2023-11-28T13:30:58.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:58.523 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:30:58.523 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:30:58.829 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-11-28T13:30:58.829 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-11-28T13:30:58.847 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-11-28T13:30:58.848 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-11-28T13:30:58.905 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-11-28T13:30:58.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-11-28T13:30:59.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-11-28T13:30:59.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-11-28T13:30:59.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-11-28T13:30:59.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-11-28T13:30:59.260 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-11-28T13:30:59.317 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:30:59.317 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:30:59.317 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-11-28T13:30:59.317 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-11-28T13:30:59.317 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:30:59.318 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:30:59.319 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:30:59.319 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-11-28T13:30:59.319 DEBUG:teuthology.parallel:result is None 2023-11-28T13:30:59.540 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-11-28T13:30:59.540 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T13:30:59.576 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-11-28T13:30:59.576 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T13:30:59.601 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-11-28T13:30:59.601 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T13:30:59.618 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:30:59.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-11-28T13:30:59.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:59.687 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-11-28T13:30:59.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-11-28T13:30:59.755 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-11-28T13:30:59.811 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-11-28T13:30:59.811 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-11-28T13:30:59.867 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:30:59.867 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:30:59.868 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-11-28T13:30:59.869 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:30:59.869 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:30:59.869 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:30:59.869 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:30:59.869 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-11-28T13:30:59.893 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:30:59.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-28T13:30:59.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:30:59.959 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-11-28T13:31:00.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-28T13:31:00.092 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-11-28T13:31:00.153 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-11-28T13:31:00.153 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-28T13:31:00.214 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:31:00.214 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:31:00.214 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-28T13:31:00.215 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:31:00.216 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:31:00.216 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:31:00.216 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:31:00.216 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-28T13:31:00.242 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:31:00.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-11-28T13:31:00.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:31:00.309 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-11-28T13:31:00.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-11-28T13:31:00.438 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-11-28T13:31:00.496 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-11-28T13:31:00.496 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-11-28T13:31:00.554 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:31:00.554 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:31:00.554 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-11-28T13:31:00.554 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:31:00.555 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:31:00.556 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-11-28T13:31:00.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:31:00.674 INFO:teuthology.dispatcher.supervisor:Running job 7470025 2023-11-28T13:31:00.675 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025 --name rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025/orig.config.yaml 2023-11-28T13:31:00.684 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025 2023-11-28T13:31:00.685 INFO:teuthology.dispatcher.supervisor:Job PID: 3902455 2023-11-28T13:31:00.685 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T13:33:00.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:35:00.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:37:01.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:39:01.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:41:01.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:43:01.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:45:01.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:47:02.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:49:02.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:51:02.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:51:02.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T13:51:02.708 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T13:51:02.708 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T13:51:02.759 DEBUG:teuthology.nuke:shortname: smithi092 2023-11-28T13:51:02.760 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:51:02.788 DEBUG:teuthology.nuke:shortname: smithi112 2023-11-28T13:51:02.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:51:02.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:25:49.271587', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:51:02.816 DEBUG:teuthology.nuke:shortname: smithi169 2023-11-28T13:51:02.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:51:02.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:25:49.273287', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:51:02.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:25:49.269741', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:51:02.856 INFO:teuthology.orchestra.console.smithi092:Power off 2023-11-28T13:51:02.857 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:51:02.882 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-11-28T13:51:02.883 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:51:02.900 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-28T13:51:02.901 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:51:02.911 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-28T13:51:02.921 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-28T13:51:02.921 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:51:02.941 INFO:teuthology.orchestra.console.smithi169:Power off 2023-11-28T13:51:02.942 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:51:02.952 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-28T13:51:02.964 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-11-28T13:51:02.964 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:51:02.985 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-11-28T13:51:03.012 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-11-28T13:51:03.053 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-28T13:51:03.086 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-11-28T13:51:03.163 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-11-28T13:51:03.195 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-11-28T13:51:03.238 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com