2023-10-25T08:22:24.420 INFO:root:teuthology version: 0.0.1.dev201+g202b180
2023-10-25T08:22:24.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:22:24.552 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff4da1ccb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff4dacd2670>, signals=[15])
2023-10-25T08:22:24.554 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2023-10-25T08:22:24.554 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2023-10-25T08:22:24.554 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-10-25T08:22:24.578 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2023-10-25T08:22:24.579 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2023-10-25T08:22:24.579 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-10-25T08:22:24.580 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"}
2023-10-25T08:22:24.603 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"}
2023-10-25T08:22:24.660 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-25T08:22:24.671 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-25T08:22:24.704 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10)
2023-10-25T08:22:24.704 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 10}
2023-10-25T08:22:24.715 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10)
2023-10-25T08:22:24.715 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 10}
2023-10-25T08:22:24.749 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream
2023-10-25T08:22:24.749 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:22:24.759 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream
2023-10-25T08:22:24.759 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:22:24.797 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"}
2023-10-25T08:22:24.804 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"}
2023-10-25T08:22:24.834 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1}
2023-10-25T08:22:24.845 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1}
2023-10-25T08:22:24.884 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:22:24.894 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:22:24.974 INFO:teuthology.orchestra.console.smithi050:Power off
2023-10-25T08:22:24.975 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-25T08:22:24.989 INFO:teuthology.orchestra.console.smithi183:Power off
2023-10-25T08:22:24.990 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-25T08:22:25.004 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-10-25T08:22:25.005 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:25.013 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-10-25T08:22:25.014 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:25.028 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-10-25T08:22:25.038 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-10-25T08:22:29.030 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:29.039 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:29.139 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-10-25T08:22:29.147 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-10-25T08:22:33.141 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:33.148 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:33.251 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-10-25T08:22:33.259 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-10-25T08:22:33.352 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-10-25T08:22:33.453 INFO:teuthology.orchestra.console.smithi050:Power on
2023-10-25T08:22:33.453 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-25T08:22:33.474 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2023-10-25T08:22:33.474 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:33.497 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-10-25T08:22:37.262 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:37.370 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-10-25T08:22:37.471 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-10-25T08:22:37.498 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:37.573 INFO:teuthology.orchestra.console.smithi183:Power on
2023-10-25T08:22:37.574 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-25T08:22:37.598 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2023-10-25T08:22:37.599 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:37.608 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-10-25T08:22:37.623 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-10-25T08:22:41.610 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:41.624 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T08:22:41.719 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-10-25T08:22:41.732 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-10-25T08:22:41.820 INFO:teuthology.orchestra.console.smithi050:Power on completed
2023-10-25T08:22:41.834 INFO:teuthology.orchestra.console.smithi183:Power on completed
2023-10-25T08:22:41.922 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2023-10-25T08:22:41.922 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:22:41.934 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2023-10-25T08:22:41.935 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:22:56.993 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:22:56.994 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:23:12.066 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:23:12.068 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:23:27.142 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:23:27.144 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:23:42.218 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:23:42.220 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:23:57.291 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:23:57.294 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:24:12.366 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:24:12.368 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:24:27.441 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:24:27.443 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:24:42.514 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:24:42.516 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:24:57.582 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:24:57.584 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-10-25T08:24:57.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:24:57.930 ERROR:teuthology.orchestra.connection:Error authenticating with smithi050.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-10-25T08:25:12.642 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None
2023-10-25T08:25:12.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:25:31.259 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-10-25T08:25:37.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:25:40.318 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-10-25T08:25:46.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:25:49.370 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-10-25T08:25:55.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:25:58.430 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-10-25T08:26:01.934 WARNING:teuthology.provision.fog.smithi050:timed out
2023-10-25T08:26:04.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:26:07.482 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-10-25T08:26:07.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:26:13.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:26:26.299 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-10-25T08:26:32.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:26:33.266 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-25T08:26:33.267 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-25T08:26:53.627 INFO:teuthology.provision.fog.smithi050:Node is ready
2023-10-25T08:26:53.627 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2023-10-25T08:26:53.647 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2023-10-25T08:26:53.648 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2023-10-25T08:26:53.706 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2023-10-25T08:26:53.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-10-25T08:26:53.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2023-10-25T08:26:53.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2023-10-25T08:26:53.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2023-10-25T08:26:54.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-10-25T08:26:54.095 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-10-25T08:26:54.151 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-10-25T08:26:54.151 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2023-10-25T08:26:54.151 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-10-25T08:26:54.152 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-10-25T08:26:54.152 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2023-10-25T08:26:54.152 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2023-10-25T08:26:54.152 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-25T08:26:54.153 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-10-25T08:26:54.153 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2023-10-25T08:26:54.153 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-25T08:26:54.153 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-10-25T08:26:54.153 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-25T08:26:54.154 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-25T08:26:54.154 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-25T08:26:54.155 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2023-10-25T08:26:54.157 DEBUG:teuthology.parallel:result is None
2023-10-25T08:27:13.487 WARNING:teuthology.provision.fog.smithi183:timed out
2023-10-25T08:27:19.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:27:19.721 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-25T08:27:19.721 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-25T08:27:20.053 INFO:teuthology.provision.fog.smithi183:Node is ready
2023-10-25T08:27:20.054 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2023-10-25T08:27:20.068 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2023-10-25T08:27:20.068 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2023-10-25T08:27:20.123 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2023-10-25T08:27:20.123 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-10-25T08:27:20.221 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2023-10-25T08:27:20.248 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2023-10-25T08:27:20.315 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2023-10-25T08:27:20.382 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-10-25T08:27:20.448 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-10-25T08:27:20.503 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2023-10-25T08:27:20.503 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2023-10-25T08:27:20.503 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2023-10-25T08:27:20.503 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2023-10-25T08:27:20.504 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2023-10-25T08:27:20.504 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2023-10-25T08:27:20.504 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-25T08:27:20.504 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-10-25T08:27:20.504 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2023-10-25T08:27:20.505 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-25T08:27:20.505 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2023-10-25T08:27:20.505 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-25T08:27:20.505 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-25T08:27:20.505 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-25T08:27:20.506 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2023-10-25T08:27:20.507 DEBUG:teuthology.parallel:result is None
2023-10-25T08:27:20.679 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2023-10-25T08:27:20.680 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-25T08:27:20.706 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2023-10-25T08:27:20.706 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-25T08:27:20.723 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2023-10-25T08:27:20.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-10-25T08:27:20.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:27:20.822 DEBUG:teuthology.orchestra.run.smithi050:> true
2023-10-25T08:27:21.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-10-25T08:27:21.005 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2023-10-25T08:27:21.060 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2023-10-25T08:27:21.060 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-10-25T08:27:21.115 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-10-25T08:27:21.115 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9"
2023-10-25T08:27:21.116 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-10-25T08:27:21.116 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-10-25T08:27:21.116 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9"
2023-10-25T08:27:21.116 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9"
2023-10-25T08:27:21.116 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-25T08:27:21.117 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-10-25T08:27:21.117 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon"
2023-10-25T08:27:21.117 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-25T08:27:21.117 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-10-25T08:27:21.118 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-25T08:27:21.118 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-25T08:27:21.118 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-25T08:27:21.119 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-10-25T08:27:21.139 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2023-10-25T08:27:21.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-10-25T08:27:21.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-25T08:27:21.220 DEBUG:teuthology.orchestra.run.smithi183:> true
2023-10-25T08:27:21.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-10-25T08:27:21.285 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2023-10-25T08:27:21.338 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2023-10-25T08:27:21.339 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-10-25T08:27:21.392 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2023-10-25T08:27:21.393 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2023-10-25T08:27:21.393 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2023-10-25T08:27:21.393 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2023-10-25T08:27:21.393 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2023-10-25T08:27:21.393 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2023-10-25T08:27:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-25T08:27:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-10-25T08:27:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2023-10-25T08:27:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-25T08:27:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2023-10-25T08:27:21.395 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-25T08:27:21.395 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-25T08:27:21.395 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-25T08:27:21.396 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-10-25T08:27:21.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:27:21.501 INFO:teuthology.dispatcher.supervisor:Running job 7436870
2023-10-25T08:27:21.502 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi/7436870 --name yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi --description rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi/7436870/orig.config.yaml
2023-10-25T08:27:21.504 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi/7436870
2023-10-25T08:27:21.505 INFO:teuthology.dispatcher.supervisor:Job PID: 32790
2023-10-25T08:27:21.505 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-25T08:29:21.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:31:21.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:33:21.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:35:21.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:37:21.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:39:21.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:41:21.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:43:22.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:45:22.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:47:22.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:49:22.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:51:22.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:53:22.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:55:22.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:57:22.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T08:59:22.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:01:22.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:03:22.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:05:22.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:07:22.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:09:22.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:11:23.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:13:23.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:15:23.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:17:23.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:19:23.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-25T09:19:23.370 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-25T09:19:23.540 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-25T09:19:23.540 INFO:teuthology.nuke:Checking targets against current locks
2023-10-25T09:19:23.591 DEBUG:teuthology.nuke:shortname: smithi050
2023-10-25T09:19:23.591 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-25T09:19:23.614 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi/7436870', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 08:22:23.624697', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMo10MYYVaE6nnVrFNFeg2Vp+AQ+sYy0RM7iDV+aMVIMhw7/Zbge+2TADFPWsROAgMRPWVa2GbkDnI4zlxfIj/c='}
2023-10-25T09:19:23.618 DEBUG:teuthology.nuke:shortname: smithi183
2023-10-25T09:19:23.619 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-25T09:19:23.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-25_08:17:17-rgw:notifications-wip-topic-policy-distro-default-smithi/7436870', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 08:22:23.626171', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkIgeIr4cHZj1erCsZrPxEJfczQfcoBn3dW7uWgs0VvmotYJvfeo9oQyea+dTJzSJ9rIhVd8/h1v77KuWOAnpE='}
2023-10-25T09:19:23.675 INFO:teuthology.orchestra.console.smithi050:Power off
2023-10-25T09:19:23.676 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-25T09:19:23.697 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-10-25T09:19:23.698 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T09:19:23.710 INFO:teuthology.orchestra.console.smithi183:Power off
2023-10-25T09:19:23.711 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-25T09:19:23.719 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-10-25T09:19:23.732 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-10-25T09:19:23.732 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-25T09:19:23.754 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-10-25T09:19:23.820 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-10-25T09:19:23.855 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-10-25T09:19:23.967 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2023-10-25T09:19:24.000 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com