2023-11-23T02:25:58.894 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T02:25:58.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:25:59.030 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa749081940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa748d7cf70>, signals=[15])
2023-11-23T02:25:59.031 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-11-23T02:25:59.031 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:25:59.031 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-11-23T02:25:59.051 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-11-23T02:25:59.051 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:25:59.051 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-11-23T02:25:59.170 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:25:59.181 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:25:59.210 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.stream
2023-11-23T02:25:59.224 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2023-11-23T02:25:59.517 INFO:teuthology.orchestra.console.smithi031:Power off
2023-11-23T02:25:59.517 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:25:59.529 INFO:teuthology.orchestra.console.smithi120:Power off
2023-11-23T02:25:59.529 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:25:59.538 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2023-11-23T02:25:59.538 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:25:59.548 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-11-23T02:25:59.548 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:25:59.558 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2023-11-23T02:25:59.568 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-11-23T02:25:59.659 INFO:teuthology.orchestra.console.smithi031:Power off completed
2023-11-23T02:25:59.669 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-11-23T02:25:59.760 INFO:teuthology.orchestra.console.smithi031:Power on
2023-11-23T02:25:59.760 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:25:59.770 INFO:teuthology.orchestra.console.smithi120:Power on
2023-11-23T02:25:59.770 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:25:59.780 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2023-11-23T02:25:59.780 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:25:59.788 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2023-11-23T02:25:59.789 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:25:59.803 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2023-11-23T02:25:59.807 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-11-23T02:26:03.808 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:03.815 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:03.918 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2023-11-23T02:26:03.923 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-11-23T02:26:04.023 INFO:teuthology.orchestra.console.smithi120:Power on completed
2023-11-23T02:26:04.124 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-11-23T02:26:07.922 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:08.030 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2023-11-23T02:26:08.130 INFO:teuthology.orchestra.console.smithi031:Power on completed
2023-11-23T02:26:08.231 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-11-23T02:29:03.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:29:21.890 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-11-23T02:29:27.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:29:30.947 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-11-23T02:29:36.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:29:40.002 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-11-23T02:29:46.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:29:49.058 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-11-23T02:29:55.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:30:55.075 WARNING:teuthology.provision.fog.smithi120:timed out
2023-11-23T02:31:01.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:31:01.309 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:31:01.309 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:31:01.555 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-11-23T02:31:01.555 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-11-23T02:31:01.574 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2023-11-23T02:31:01.574 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts
2023-11-23T02:31:01.633 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2023-11-23T02:31:01.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-11-23T02:31:01.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts
2023-11-23T02:31:01.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2023-11-23T02:31:01.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname
2023-11-23T02:31:01.895 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-11-23T02:31:01.962 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2023-11-23T02:31:02.019 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:31:02.020 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:31:02.020 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2023-11-23T02:31:02.022 DEBUG:teuthology.parallel:result is None
2023-11-23T02:32:52.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:33:11.266 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-11-23T02:33:17.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:33:20.322 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-11-23T02:33:26.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:33:29.378 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-11-23T02:33:35.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:35.442 WARNING:teuthology.provision.fog.smithi031:timed out
2023-11-23T02:34:41.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:41.684 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:34:41.684 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:34:41.934 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-11-23T02:34:41.934 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2023-11-23T02:34:41.954 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2023-11-23T02:34:41.955 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2023-11-23T02:34:42.016 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2023-11-23T02:34:42.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-11-23T02:34:42.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2023-11-23T02:34:42.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2023-11-23T02:34:42.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2023-11-23T02:34:42.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-11-23T02:34:42.361 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:34:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:34:42.421 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:34:42.421 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2023-11-23T02:34:42.421 DEBUG:teuthology.parallel:result is None
2023-11-23T02:34:42.572 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2023-11-23T02:34:42.572 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:34:42.591 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2023-11-23T02:34:42.591 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:34:42.610 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:34:42.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-11-23T02:34:42.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:42.679 DEBUG:teuthology.orchestra.run.smithi031:> true
2023-11-23T02:34:42.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-11-23T02:34:42.748 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2023-11-23T02:34:42.807 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2023-11-23T02:34:42.807 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-11-23T02:34:42.866 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2023-11-23T02:34:42.866 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8"
2023-11-23T02:34:42.866 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:34:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:34:42.868 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-11-23T02:34:42.892 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:34:42.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-11-23T02:34:42.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:42.960 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-11-23T02:34:43.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-11-23T02:34:43.055 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2023-11-23T02:34:43.114 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2023-11-23T02:34:43.114 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-11-23T02:34:43.172 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:34:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:34:43.174 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-11-23T02:34:43.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:34:43.291 INFO:teuthology.dispatcher.supervisor:Running job 7464484
2023-11-23T02:34:43.291 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464484 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464484/orig.config.yaml
2023-11-23T02:34:43.294 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464484
2023-11-23T02:34:43.294 INFO:teuthology.dispatcher.supervisor:Job PID: 222019
2023-11-23T02:34:43.295 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T02:36:43.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:38:43.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:40:43.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:42:43.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:44:44.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:46:44.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:48:44.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:50:44.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:52:44.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:54:44.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:56:45.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:58:45.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:00:45.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:02:45.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:04:45.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:06:45.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:08:46.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:10:46.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:12:46.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:14:46.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:16:46.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:18:46.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:20:47.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:22:47.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:24:47.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:26:47.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:28:47.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:30:48.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:32:48.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:34:48.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:36:48.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:38:48.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:40:48.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:42:48.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:44:49.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:46:49.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:48:49.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:50:49.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:52:49.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:54:49.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:56:50.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:56:50.114 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T03:56:50.232 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T03:56:50.232 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T03:56:50.280 DEBUG:teuthology.nuke:shortname: smithi031
2023-11-23T03:56:50.280 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:56:50.298 DEBUG:teuthology.nuke:shortname: smithi120
2023-11-23T03:56:50.298 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:56:50.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:25:58.113173', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHfHJGnHwT5maPY76POO7OOqEX2nBfts2q9iFymk+t4dQInc5UVtIrZ3XkvN2yX4yQfkGFeWk841XFrXSxvIaM='}
2023-11-23T03:56:50.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:25:58.114907', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBACdOaVN4lvLlarYuu1srq5FmCI3LM42aSRF5pWPplN8XqTiYtW4smw3QzjdSQ0oRateiiiz5084Y7Hn5iHstCY='}
2023-11-23T03:56:50.347 INFO:teuthology.orchestra.console.smithi031:Power off
2023-11-23T03:56:50.347 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:56:50.367 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2023-11-23T03:56:50.367 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:56:50.384 INFO:teuthology.orchestra.console.smithi120:Power off
2023-11-23T03:56:50.384 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:56:50.393 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2023-11-23T03:56:50.405 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-11-23T03:56:50.405 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:56:50.425 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-11-23T03:56:50.494 INFO:teuthology.orchestra.console.smithi031:Power off completed
2023-11-23T03:56:50.526 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-11-23T03:56:50.646 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-11-23T03:56:50.672 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com