2023-11-13T07:50:00.593 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-13T07:50:00.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T07:50:00.722 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5631041ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5630debb80>, signals=[15])
2023-11-13T07:50:00.723 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2023-11-13T07:50:00.724 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T07:50:00.724 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2023-11-13T07:50:00.749 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging
2023-11-13T07:50:00.750 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T07:50:00.750 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2023-11-13T07:50:00.751 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"}
2023-11-13T07:50:00.774 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"}
2023-11-13T07:50:00.819 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-13T07:50:00.842 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-13T07:50:00.871 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10)
2023-11-13T07:50:00.871 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 10}
2023-11-13T07:50:00.882 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10)
2023-11-13T07:50:00.883 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 10}
2023-11-13T07:50:00.911 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream
2023-11-13T07:50:00.911 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:00.928 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream
2023-11-13T07:50:00.928 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:50:00.959 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T07:50:00.971 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T07:50:00.994 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1}
2023-11-13T07:50:01.012 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1}
2023-11-13T07:50:01.047 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:01.062 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:50:01.124 INFO:teuthology.orchestra.console.smithi077:Power off
2023-11-13T07:50:01.125 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T07:50:01.138 INFO:teuthology.orchestra.console.smithi141:Power off
2023-11-13T07:50:01.138 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T07:50:01.145 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2023-11-13T07:50:01.146 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:01.157 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2023-11-13T07:50:01.158 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:01.166 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2023-11-13T07:50:01.177 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2023-11-13T07:50:01.268 INFO:teuthology.orchestra.console.smithi077:Power off completed
2023-11-13T07:50:01.278 INFO:teuthology.orchestra.console.smithi141:Power off completed
2023-11-13T07:50:01.369 INFO:teuthology.orchestra.console.smithi077:Power on
2023-11-13T07:50:01.369 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T07:50:01.380 INFO:teuthology.orchestra.console.smithi141:Power on
2023-11-13T07:50:01.381 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T07:50:01.390 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On
2023-11-13T07:50:01.391 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:01.403 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On
2023-11-13T07:50:01.404 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:01.411 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2023-11-13T07:50:01.423 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2023-11-13T07:50:05.417 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:05.424 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:05.526 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2023-11-13T07:50:05.533 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2023-11-13T07:50:09.531 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:09.538 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T07:50:09.640 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2023-11-13T07:50:09.646 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2023-11-13T07:50:09.742 INFO:teuthology.orchestra.console.smithi077:Power on completed
2023-11-13T07:50:09.747 INFO:teuthology.orchestra.console.smithi141:Power on completed
2023-11-13T07:50:09.843 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2023-11-13T07:50:09.843 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:09.847 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2023-11-13T07:50:09.848 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:50:24.926 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:24.928 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:50:40.003 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:40.007 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:50:55.081 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:50:55.089 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:51:10.161 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:51:10.164 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:51:25.231 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:51:25.234 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:51:40.308 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:51:40.309 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:51:55.373 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:51:55.375 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:52:10.438 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:52:10.449 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:52:25.510 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:52:25.521 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:52:40.579 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-11-13T07:52:40.581 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None
2023-11-13T07:52:40.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:52:40.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:52:59.003 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2023-11-13T07:52:59.004 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-11-13T07:53:05.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:05.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:08.090 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2023-11-13T07:53:08.091 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-11-13T07:53:14.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:14.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:17.183 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2023-11-13T07:53:17.183 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-11-13T07:53:23.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:23.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:26.270 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2023-11-13T07:53:26.273 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-11-13T07:53:32.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:32.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:35.354 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2023-11-13T07:53:35.355 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-11-13T07:53:41.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:53:41.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:54:41.427 WARNING:teuthology.provision.fog.smithi077:timed out
2023-11-13T07:54:41.430 WARNING:teuthology.provision.fog.smithi141:timed out
2023-11-13T07:54:47.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:54:47.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:54:47.685 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T07:54:47.686 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T07:54:47.762 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T07:54:47.762 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T07:54:48.014 INFO:teuthology.provision.fog.smithi077:Node is ready
2023-11-13T07:54:48.014 DEBUG:teuthology.orchestra.run.smithi077:> hostname
2023-11-13T07:54:48.029 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2023-11-13T07:54:48.029 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts
2023-11-13T07:54:48.084 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2023-11-13T07:54:48.085 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2023-11-13T07:54:48.097 INFO:teuthology.provision.fog.smithi141:Node is ready
2023-11-13T07:54:48.097 DEBUG:teuthology.orchestra.run.smithi141:> hostname
2023-11-13T07:54:48.112 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2023-11-13T07:54:48.113 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts
2023-11-13T07:54:48.169 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2023-11-13T07:54:48.169 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2023-11-13T07:54:48.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts
2023-11-13T07:54:48.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts
2023-11-13T07:54:48.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname
2023-11-13T07:54:48.283 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts
2023-11-13T07:54:48.311 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts
2023-11-13T07:54:48.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2023-11-13T07:54:48.378 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname
2023-11-13T07:54:48.414 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2023-11-13T07:54:48.446 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2023-11-13T07:54:48.468 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2023-11-13T07:54:48.469 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9"
2023-11-13T07:54:48.469 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2023-11-13T07:54:48.469 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2023-11-13T07:54:48.470 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9"
2023-11-13T07:54:48.470 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9"
2023-11-13T07:54:48.470 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T07:54:48.471 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2023-11-13T07:54:48.471 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon"
2023-11-13T07:54:48.471 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T07:54:48.471 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2023-11-13T07:54:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T07:54:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T07:54:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T07:54:48.473 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2023-11-13T07:54:48.476 DEBUG:teuthology.parallel:result is None
2023-11-13T07:54:48.512 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2023-11-13T07:54:48.566 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2023-11-13T07:54:48.567 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9"
2023-11-13T07:54:48.567 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2023-11-13T07:54:48.567 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2023-11-13T07:54:48.567 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9"
2023-11-13T07:54:48.568 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9"
2023-11-13T07:54:48.568 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T07:54:48.568 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2023-11-13T07:54:48.568 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon"
2023-11-13T07:54:48.569 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T07:54:48.569 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2023-11-13T07:54:48.569 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T07:54:48.569 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T07:54:48.570 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T07:54:48.570 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2023-11-13T07:54:48.571 DEBUG:teuthology.parallel:result is None
2023-11-13T07:54:48.772 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2023-11-13T07:54:48.773 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-13T07:54:48.800 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2023-11-13T07:54:48.800 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-13T07:54:48.817 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2023-11-13T07:54:48.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2023-11-13T07:54:48.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:54:48.901 DEBUG:teuthology.orchestra.run.smithi077:> true
2023-11-13T07:54:48.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com'
2023-11-13T07:54:48.968 DEBUG:teuthology.orchestra.run.smithi077:> uname -m
2023-11-13T07:54:49.022 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2023-11-13T07:54:49.022 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2023-11-13T07:54:49.077 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2023-11-13T07:54:49.077 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9"
2023-11-13T07:54:49.077 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2023-11-13T07:54:49.077 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2023-11-13T07:54:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9"
2023-11-13T07:54:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9"
2023-11-13T07:54:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T07:54:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2023-11-13T07:54:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon"
2023-11-13T07:54:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T07:54:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2023-11-13T07:54:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T07:54:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T07:54:49.080 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T07:54:49.080 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2023-11-13T07:54:49.108 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2023-11-13T07:54:49.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-11-13T07:54:49.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T07:54:49.187 DEBUG:teuthology.orchestra.run.smithi141:> true
2023-11-13T07:54:49.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-11-13T07:54:49.252 DEBUG:teuthology.orchestra.run.smithi141:> uname -m
2023-11-13T07:54:49.306 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2023-11-13T07:54:49.307 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2023-11-13T07:54:49.360 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2023-11-13T07:54:49.360 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9"
2023-11-13T07:54:49.360 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2023-11-13T07:54:49.360 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2023-11-13T07:54:49.361 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9"
2023-11-13T07:54:49.361 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9"
2023-11-13T07:54:49.361 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T07:54:49.361 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2023-11-13T07:54:49.361 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon"
2023-11-13T07:54:49.362 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T07:54:49.362 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2023-11-13T07:54:49.362 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T07:54:49.362 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T07:54:49.362 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T07:54:49.363 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2023-11-13T07:54:49.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T07:54:49.480 INFO:teuthology.dispatcher.supervisor:Running job 7456157
2023-11-13T07:54:49.480 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi/7456157 --name nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi/7456157/orig.config.yaml
2023-11-13T07:54:49.483 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi/7456157
2023-11-13T07:54:49.484 INFO:teuthology.dispatcher.supervisor:Job PID: 3013794
2023-11-13T07:54:49.484 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-13T07:56:49.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T07:58:49.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:00:49.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:02:50.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:04:50.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:06:50.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:08:50.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:10:50.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:12:51.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:14:51.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:16:51.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:18:51.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:20:51.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:22:51.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:24:52.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:26:52.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:28:52.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T08:28:52.792 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-13T08:28:52.897 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-13T08:28:52.897 INFO:teuthology.nuke:Checking targets against current locks
2023-11-13T08:28:52.948 DEBUG:teuthology.nuke:shortname: smithi077
2023-11-13T08:28:52.949 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T08:28:52.972 DEBUG:teuthology.nuke:shortname: smithi141
2023-11-13T08:28:52.973 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T08:28:52.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi/7456157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 07:49:59.812867', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAezKqM22+ZuurDx00mAYNFuHL/+Ws17pCCzWwLWW8g+k7yOe5F/GHwNS9T7ObMf4UylYMKEv61AOis5e2ilIbc='}
2023-11-13T08:28:53.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-13_07:49:08-rados:thrash-dedup-main-distro-default-smithi/7456157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 07:49:59.814267', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwBXYiyu/ekEDFYEOHCjEvLW5hRrTv2NlAH+6slQJL7mfHK8qMNX7eKZNk1ATCAiroc6X/DKoBqoKVzPeAq4Po='}
2023-11-13T08:28:53.024 INFO:teuthology.orchestra.console.smithi077:Power off
2023-11-13T08:28:53.025 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T08:28:53.047 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2023-11-13T08:28:53.047 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T08:28:53.059 INFO:teuthology.orchestra.console.smithi141:Power off
2023-11-13T08:28:53.060 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T08:28:53.069 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2023-11-13T08:28:53.082 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2023-11-13T08:28:53.082 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T08:28:53.100 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2023-11-13T08:28:53.171 INFO:teuthology.orchestra.console.smithi077:Power off completed
2023-11-13T08:28:53.201 INFO:teuthology.orchestra.console.smithi141:Power off completed
2023-11-13T08:28:53.340 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2023-11-13T08:28:53.348 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com