2023-11-13T09:06:37.668 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-13T09:06:37.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:06:37.799 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f46d19f5b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f46d179db80>, signals=[15])
2023-11-13T09:06:37.800 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2023-11-13T09:06:37.801 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T09:06:37.801 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-11-13T09:06:37.826 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-11-13T09:06:37.826 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T09:06:37.827 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-11-13T09:06:37.828 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"}
2023-11-13T09:06:37.851 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"}
2023-11-13T09:06:37.898 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-13T09:06:37.912 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-13T09:06:37.944 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10)
2023-11-13T09:06:37.945 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 10}
2023-11-13T09:06:37.960 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10)
2023-11-13T09:06:37.961 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 10}
2023-11-13T09:06:37.989 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream
2023-11-13T09:06:37.989 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:06:38.004 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream
2023-11-13T09:06:38.004 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:06:38.033 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T09:06:38.037 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T09:06:38.070 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1}
2023-11-13T09:06:38.073 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1}
2023-11-13T09:06:38.125 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:06:38.130 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:06:38.197 INFO:teuthology.orchestra.console.smithi002:Power off
2023-11-13T09:06:38.197 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T09:06:38.211 INFO:teuthology.orchestra.console.smithi124:Power off
2023-11-13T09:06:38.211 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T09:06:38.220 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2023-11-13T09:06:38.221 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:38.231 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-11-13T09:06:38.232 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:38.240 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-11-13T09:06:38.252 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-13T09:06:38.342 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-11-13T09:06:38.353 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-11-13T09:06:38.443 INFO:teuthology.orchestra.console.smithi002:Power on
2023-11-13T09:06:38.444 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T09:06:38.454 INFO:teuthology.orchestra.console.smithi124:Power on
2023-11-13T09:06:38.455 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T09:06:38.464 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2023-11-13T09:06:38.465 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:38.478 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-11-13T09:06:38.479 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:38.489 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-11-13T09:06:38.499 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-13T09:06:42.494 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:42.504 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:42.607 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-11-13T09:06:42.615 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-13T09:06:46.613 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:46.621 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:06:46.724 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-11-13T09:06:46.732 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-11-13T09:06:46.825 INFO:teuthology.orchestra.console.smithi002:Power on completed
2023-11-13T09:06:46.834 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-11-13T09:06:46.926 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2023-11-13T09:06:46.927 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:06:46.935 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-11-13T09:06:46.935 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:07:02.003 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:07:02.004 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:07:17.076 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:07:17.081 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:07:32.151 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:07:32.153 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:07:47.232 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:07:47.234 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:08:02.309 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:08:02.311 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:08:17.380 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:08:17.382 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:08:32.455 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:08:32.457 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:08:47.532 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:08:47.534 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:09:02.609 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:09:02.614 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:09:17.689 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-13T09:09:17.691 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-11-13T09:09:17.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:17.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:36.250 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-11-13T09:09:36.252 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-13T09:09:42.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:42.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:45.338 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-11-13T09:09:45.339 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-13T09:09:51.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:51.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:09:54.426 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-11-13T09:09:54.427 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-13T09:10:00.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:10:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:10:03.514 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-13T09:10:09.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:10:12.602 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-13T09:10:18.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:11:00.464 WARNING:teuthology.provision.fog.smithi002:timed out
2023-11-13T09:11:06.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:11:06.741 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T09:11:06.742 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T09:11:07.087 INFO:teuthology.provision.fog.smithi002:Node is ready
2023-11-13T09:11:07.087 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2023-11-13T09:11:07.103 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2023-11-13T09:11:07.103 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts
2023-11-13T09:11:07.159 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2023-11-13T09:11:07.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-11-13T09:11:07.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts
2023-11-13T09:11:07.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts
2023-11-13T09:11:07.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname
2023-11-13T09:11:07.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-11-13T09:11:07.519 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-11-13T09:11:07.575 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-11-13T09:11:07.575 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-11-13T09:11:07.575 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-11-13T09:11:07.575 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-11-13T09:11:07.576 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T09:11:07.577 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-11-13T09:11:07.577 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T09:11:07.577 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T09:11:07.577 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T09:11:07.578 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2023-11-13T09:11:07.579 DEBUG:teuthology.parallel:result is None
2023-11-13T09:11:18.627 WARNING:teuthology.provision.fog.smithi124:timed out
2023-11-13T09:11:24.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:11:24.877 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T09:11:24.877 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T09:11:25.199 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-11-13T09:11:25.199 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-11-13T09:11:25.213 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-11-13T09:11:25.213 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-11-13T09:11:25.267 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-11-13T09:11:25.267 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-11-13T09:11:25.380 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-11-13T09:11:25.407 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-11-13T09:11:25.474 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-11-13T09:11:25.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-11-13T09:11:25.605 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-11-13T09:11:25.658 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-11-13T09:11:25.659 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T09:11:25.660 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T09:11:25.661 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T09:11:25.661 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-11-13T09:11:25.662 DEBUG:teuthology.parallel:result is None
2023-11-13T09:11:25.833 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2023-11-13T09:11:25.834 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-13T09:11:25.859 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-11-13T09:11:25.860 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-13T09:11:25.876 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2023-11-13T09:11:25.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-11-13T09:11:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:11:25.976 DEBUG:teuthology.orchestra.run.smithi002:> true
2023-11-13T09:11:26.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-11-13T09:11:26.156 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2023-11-13T09:11:26.211 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2023-11-13T09:11:26.211 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-11-13T09:11:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-11-13T09:11:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-11-13T09:11:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-11-13T09:11:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-11-13T09:11:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T09:11:26.267 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-11-13T09:11:26.268 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T09:11:26.268 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T09:11:26.268 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T09:11:26.268 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-11-13T09:11:26.293 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-11-13T09:11:26.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-11-13T09:11:26.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T09:11:26.374 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-11-13T09:11:26.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-11-13T09:11:26.440 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-11-13T09:11:26.493 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-11-13T09:11:26.494 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-11-13T09:11:26.549 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-11-13T09:11:26.549 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-11-13T09:11:26.550 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-11-13T09:11:26.550 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-11-13T09:11:26.550 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-11-13T09:11:26.550 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-11-13T09:11:26.550 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-13T09:11:26.551 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-11-13T09:11:26.551 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-11-13T09:11:26.551 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-13T09:11:26.551 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-11-13T09:11:26.551 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T09:11:26.552 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-13T09:11:26.552 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-13T09:11:26.552 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-11-13T09:11:26.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:11:26.673 INFO:teuthology.dispatcher.supervisor:Running job 7456160
2023-11-13T09:11:26.673 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi/7456160 --name nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi/7456160/orig.config.yaml
2023-11-13T09:11:26.676 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi/7456160
2023-11-13T09:11:26.676 INFO:teuthology.dispatcher.supervisor:Job PID: 3045457
2023-11-13T09:11:26.677 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-13T09:13:26.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:15:26.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:17:27.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:19:27.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:21:27.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:23:27.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:25:27.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:27:27.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:29:27.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:31:28.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:33:28.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:35:28.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:37:28.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:39:28.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:41:28.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:43:28.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:45:29.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T09:45:29.165 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-13T09:45:29.267 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-13T09:45:29.268 INFO:teuthology.nuke:Checking targets against current locks
2023-11-13T09:45:29.318 DEBUG:teuthology.nuke:shortname: smithi002
2023-11-13T09:45:29.319 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T09:45:29.335 DEBUG:teuthology.nuke:shortname: smithi124
2023-11-13T09:45:29.335 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T09:45:29.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi/7456160', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 09:06:36.946995', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUPuUgcSjtLIEUjTsl9tFLjokQDPP4BnCEbBlXXjvRDkK/eRH/DRTHeBYDFZ7FGZ+LFet6mBrnl/j2BuiVZ57Y='}
2023-11-13T09:45:29.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-13_09:05:43-rados:thrash-dedup-main-distro-default-smithi/7456160', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 09:06:36.945192', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEEY8oiORloTbFHyH91t48OaWV9y0KNUHumYW/MTmZh05eElGKJOubrt3NuSMZ56hB4ea21LhMYFUWoPjAt51bU='}
2023-11-13T09:45:29.389 INFO:teuthology.orchestra.console.smithi002:Power off
2023-11-13T09:45:29.390 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T09:45:29.402 INFO:teuthology.orchestra.console.smithi124:Power off
2023-11-13T09:45:29.403 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T09:45:29.413 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2023-11-13T09:45:29.414 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:45:29.423 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-11-13T09:45:29.423 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T09:45:29.435 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-11-13T09:45:29.447 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-13T09:45:29.536 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-11-13T09:45:29.548 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-11-13T09:45:29.681 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2023-11-13T09:45:29.698 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com