2023-11-05T07:39:44.627 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-05T07:39:44.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:39:44.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fec4f3deb80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fec4f17ac10>, signals=[15])
2023-11-05T07:39:44.768 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2023-11-05T07:39:44.768 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2023-11-05T07:39:44.768 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-11-05T07:39:44.789 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2023-11-05T07:39:44.790 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2023-11-05T07:39:44.790 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-05T07:39:44.791 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"}
2023-11-05T07:39:44.814 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"}
2023-11-05T07:39:44.856 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-05T07:39:44.881 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-05T07:39:44.896 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10)
2023-11-05T07:39:44.896 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 10}
2023-11-05T07:39:44.919 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10)
2023-11-05T07:39:44.920 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 10}
2023-11-05T07:39:44.941 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream
2023-11-05T07:39:44.941 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:39:44.958 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream
2023-11-05T07:39:44.958 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:39:44.995 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"}
2023-11-05T07:39:45.010 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"}
2023-11-05T07:39:45.030 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1}
2023-11-05T07:39:45.048 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1}
2023-11-05T07:39:45.088 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:39:45.093 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:39:45.184 INFO:teuthology.orchestra.console.smithi012:Power off
2023-11-05T07:39:45.185 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-05T07:39:45.198 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-05T07:39:45.198 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-05T07:39:45.206 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2023-11-05T07:39:45.207 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:45.220 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-05T07:39:45.220 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:45.229 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-11-05T07:39:45.242 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-05T07:39:45.329 INFO:teuthology.orchestra.console.smithi012:Power off completed
2023-11-05T07:39:45.343 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-05T07:39:45.431 INFO:teuthology.orchestra.console.smithi012:Power on
2023-11-05T07:39:45.431 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-05T07:39:45.444 INFO:teuthology.orchestra.console.smithi154:Power on
2023-11-05T07:39:45.445 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-05T07:39:45.452 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On
2023-11-05T07:39:45.453 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:45.467 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2023-11-05T07:39:45.468 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:45.477 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-11-05T07:39:45.487 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-05T07:39:49.482 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:49.490 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T07:39:49.593 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2023-11-05T07:39:49.600 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-05T07:39:49.695 INFO:teuthology.orchestra.console.smithi012:Power on completed
2023-11-05T07:39:49.701 INFO:teuthology.orchestra.console.smithi154:Power on completed
2023-11-05T07:39:49.796 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2023-11-05T07:39:49.797 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:39:49.803 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2023-11-05T07:39:49.803 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:40:04.887 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:40:04.889 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:40:19.968 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:40:19.969 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:40:35.049 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:40:35.051 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:40:50.134 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:40:50.136 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:41:05.226 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:41:05.228 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:41:20.310 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:41:20.312 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:41:35.402 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:41:35.404 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:41:50.514 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:41:50.516 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:42:05.610 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None
2023-11-05T07:42:05.612 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:42:05.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:42:05.814 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-05T07:42:20.695 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:42:35.757 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-05T07:42:35.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:42:38.878 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:42:44.346 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-11-05T07:42:44.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:42:47.934 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:42:50.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:42:53.402 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-11-05T07:42:53.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:42:56.986 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:42:59.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:02.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:06.042 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:43:12.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:15.102 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:43:17.886 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-11-05T07:43:21.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:23.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:24.154 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:43:26.938 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-11-05T07:43:30.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:32.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:33.211 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-05T07:43:34.742 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-05T07:43:34.743 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-05T07:43:39.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:43:55.107 INFO:teuthology.provision.fog.smithi012:Node is ready
2023-11-05T07:43:55.107 DEBUG:teuthology.orchestra.run.smithi012:> hostname
2023-11-05T07:43:55.127 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2023-11-05T07:43:55.127 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts
2023-11-05T07:43:55.185 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2023-11-05T07:43:55.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2023-11-05T07:43:55.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts
2023-11-05T07:43:55.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts
2023-11-05T07:43:55.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname
2023-11-05T07:43:55.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2023-11-05T07:43:55.561 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2023-11-05T07:43:55.616 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2023-11-05T07:43:55.616 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2023-11-05T07:43:55.616 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2023-11-05T07:43:55.617 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2023-11-05T07:43:55.617 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2023-11-05T07:43:55.617 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2023-11-05T07:43:55.617 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-05T07:43:55.617 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2023-11-05T07:43:55.618 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2023-11-05T07:43:55.618 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-05T07:43:55.618 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2023-11-05T07:43:55.618 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-05T07:43:55.618 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-05T07:43:55.619 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-05T07:43:55.620 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2023-11-05T07:43:55.622 DEBUG:teuthology.parallel:result is None
2023-11-05T07:44:39.215 WARNING:teuthology.provision.fog.smithi154:timed out
2023-11-05T07:44:45.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:44:45.459 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-05T07:44:45.460 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-05T07:44:45.779 INFO:teuthology.provision.fog.smithi154:Node is ready
2023-11-05T07:44:45.779 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2023-11-05T07:44:45.793 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2023-11-05T07:44:45.794 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2023-11-05T07:44:45.849 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2023-11-05T07:44:45.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-05T07:44:45.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2023-11-05T07:44:45.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2023-11-05T07:44:46.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2023-11-05T07:44:46.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-05T07:44:46.183 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-05T07:44:46.241 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-05T07:44:46.241 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2023-11-05T07:44:46.241 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-05T07:44:46.241 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-05T07:44:46.242 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2023-11-05T07:44:46.242 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2023-11-05T07:44:46.242 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-05T07:44:46.242 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-05T07:44:46.242 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2023-11-05T07:44:46.243 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-05T07:44:46.243 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-05T07:44:46.243 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-05T07:44:46.243 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-05T07:44:46.243 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-05T07:44:46.244 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2023-11-05T07:44:46.245 DEBUG:teuthology.parallel:result is None
2023-11-05T07:44:46.460 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2023-11-05T07:44:46.461 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-05T07:44:46.483 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2023-11-05T07:44:46.484 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-05T07:44:46.502 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2023-11-05T07:44:46.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-11-05T07:44:46.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:44:46.605 DEBUG:teuthology.orchestra.run.smithi012:> true
2023-11-05T07:44:46.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-11-05T07:44:46.794 DEBUG:teuthology.orchestra.run.smithi012:> uname -m
2023-11-05T07:44:46.850 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2023-11-05T07:44:46.850 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2023-11-05T07:44:46.905 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2023-11-05T07:44:46.905 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2023-11-05T07:44:46.905 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2023-11-05T07:44:46.905 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2023-11-05T07:44:46.906 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2023-11-05T07:44:46.906 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2023-11-05T07:44:46.906 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-05T07:44:46.906 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2023-11-05T07:44:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2023-11-05T07:44:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-05T07:44:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2023-11-05T07:44:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-05T07:44:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-05T07:44:46.908 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-05T07:44:46.908 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-11-05T07:44:46.933 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2023-11-05T07:44:46.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-05T07:44:46.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-05T07:44:47.017 DEBUG:teuthology.orchestra.run.smithi154:> true
2023-11-05T07:44:47.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-05T07:44:47.089 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2023-11-05T07:44:47.144 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2023-11-05T07:44:47.144 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-05T07:44:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-05T07:44:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2023-11-05T07:44:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-05T07:44:47.200 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-05T07:44:47.200 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2023-11-05T07:44:47.201 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2023-11-05T07:44:47.201 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-05T07:44:47.201 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-05T07:44:47.201 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2023-11-05T07:44:47.202 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-05T07:44:47.202 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-05T07:44:47.202 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-05T07:44:47.202 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-05T07:44:47.202 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-05T07:44:47.203 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-05T07:44:47.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:44:47.316 INFO:teuthology.dispatcher.supervisor:Running job 7442383
2023-11-05T07:44:47.317 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442383 --name benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442383/orig.config.yaml
2023-11-05T07:44:47.320 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442383
2023-11-05T07:44:47.321 INFO:teuthology.dispatcher.supervisor:Job PID: 3522186
2023-11-05T07:44:47.321 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-05T07:46:47.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:48:47.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:50:47.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:52:47.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:54:47.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:56:47.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T07:58:47.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:00:47.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:02:47.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:04:47.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:06:48.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:08:48.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:10:48.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:12:48.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:14:48.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:16:48.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:18:48.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:20:48.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:22:48.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:24:48.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:26:48.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:28:48.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:30:48.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:32:49.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:34:49.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:36:49.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:38:49.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:40:49.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:42:49.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:44:49.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:46:49.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:48:49.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:50:49.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:52:49.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:54:49.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:56:50.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T08:58:50.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:00:50.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:02:50.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:04:50.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:06:50.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:08:50.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:10:50.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:12:50.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:14:50.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:16:50.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:18:50.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:20:50.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:22:50.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:24:51.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:26:51.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:28:51.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:30:51.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:32:51.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:34:51.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:36:51.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:38:51.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-05T09:38:51.598 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-05T09:38:51.813 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-05T09:38:51.813 INFO:teuthology.nuke:Checking targets against current locks
2023-11-05T09:38:51.864 DEBUG:teuthology.nuke:shortname: smithi012
2023-11-05T09:38:51.865 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-05T09:38:51.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:39:43.836397', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFMQ4j6ZHLhzKnQ/WKkOlFkXivwSynpnP0QAj2kAR9QDdKRbOiLUHZvf0IJcWaRIKClGf6gghx4Ze7VSKfEWpjk='}
2023-11-05T09:38:51.894 DEBUG:teuthology.nuke:shortname: smithi154
2023-11-05T09:38:51.894 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-05T09:38:51.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:39:43.838296', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDg3dxChY+CLfgMzCl7PrHMFWprTwBCQOsjSb/YlgFTymVo0mgy6Qthnaxg9CUhCzsG+oyzYdxlALdsWbxVZlak='}
2023-11-05T09:38:51.928 INFO:teuthology.orchestra.console.smithi012:Power off
2023-11-05T09:38:51.929 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-05T09:38:51.950 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2023-11-05T09:38:51.951 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T09:38:51.966 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-05T09:38:51.966 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-05T09:38:51.975 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2023-11-05T09:38:51.987 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-05T09:38:51.988 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-05T09:38:52.011 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-05T09:38:52.076 INFO:teuthology.orchestra.console.smithi012:Power off completed
2023-11-05T09:38:52.112 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-05T09:38:52.223 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2023-11-05T09:38:52.256 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com