2023-08-09T20:44:24.829 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-09T20:44:24.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:44:24.970 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fab034bcca0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fab029deee0>, signals=[15])
2023-08-09T20:44:24.972 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2023-08-09T20:44:24.972 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2023-08-09T20:44:24.973 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-08-09T20:44:24.994 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2023-08-09T20:44:24.995 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2023-08-09T20:44:24.995 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-08-09T20:44:24.996 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"}
2023-08-09T20:44:25.017 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"}
2023-08-09T20:44:25.061 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-09T20:44:25.086 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-09T20:44:25.098 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-09T20:44:25.098 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 7}
2023-08-09T20:44:25.125 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-09T20:44:25.125 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 7}
2023-08-09T20:44:25.142 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.4
2023-08-09T20:44:25.142 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:44:25.166 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.4
2023-08-09T20:44:25.166 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:44:25.236 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"}
2023-08-09T20:44:25.239 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"}
2023-08-09T20:44:25.276 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1}
2023-08-09T20:44:25.280 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1}
2023-08-09T20:44:25.347 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:44:25.351 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:44:25.458 INFO:teuthology.orchestra.console.smithi045:Power off
2023-08-09T20:44:25.459 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-09T20:44:25.472 INFO:teuthology.orchestra.console.smithi032:Power off
2023-08-09T20:44:25.472 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-09T20:44:25.481 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off
2023-08-09T20:44:25.482 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:25.492 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2023-08-09T20:44:25.493 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:25.501 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-08-09T20:44:25.512 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-08-09T20:44:25.602 INFO:teuthology.orchestra.console.smithi045:Power off completed
2023-08-09T20:44:25.613 INFO:teuthology.orchestra.console.smithi032:Power off completed
2023-08-09T20:44:25.704 INFO:teuthology.orchestra.console.smithi045:Power on
2023-08-09T20:44:25.704 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-09T20:44:25.714 INFO:teuthology.orchestra.console.smithi032:Power on
2023-08-09T20:44:25.715 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-09T20:44:25.726 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On
2023-08-09T20:44:25.727 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:25.736 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2023-08-09T20:44:25.737 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:25.748 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-08-09T20:44:25.761 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-08-09T20:44:29.753 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:29.763 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:29.865 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-08-09T20:44:29.873 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-08-09T20:44:33.871 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:33.879 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T20:44:33.980 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on
2023-08-09T20:44:33.988 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2023-08-09T20:44:34.082 INFO:teuthology.orchestra.console.smithi045:Power on completed
2023-08-09T20:44:34.089 INFO:teuthology.orchestra.console.smithi032:Power on completed
2023-08-09T20:44:34.183 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2023-08-09T20:44:34.183 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:44:34.190 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2023-08-09T20:44:34.191 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:44:49.276 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:44:49.277 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:45:04.408 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:45:04.409 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:45:19.518 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:45:19.520 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:45:34.633 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:45:34.635 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:45:49.740 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:45:49.742 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:46:04.867 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:46:04.868 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:46:19.966 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:46:19.967 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:46:35.076 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:46:35.077 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:46:50.180 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:46:50.181 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:47:05.268 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-08-09T20:47:05.270 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:47:05.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:08.432 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-08-09T20:47:14.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:17.520 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-08-09T20:47:20.362 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:47:23.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:26.576 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-08-09T20:47:32.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:35.461 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:47:35.632 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-08-09T20:47:41.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:44.720 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-08-09T20:47:50.550 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-08-09T20:47:50.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:50.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:47:53.712 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-08-09T20:47:59.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:02.804 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-08-09T20:48:08.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:11.888 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-08-09T20:48:17.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:20.944 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-08-09T20:48:26.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:30.032 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-08-09T20:48:36.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:50.724 WARNING:teuthology.provision.fog.smithi032:timed out
2023-08-09T20:48:56.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:48:56.997 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-09T20:48:56.998 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-09T20:48:57.260 INFO:teuthology.provision.fog.smithi032:Node is ready
2023-08-09T20:48:57.261 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2023-08-09T20:48:57.276 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2023-08-09T20:48:57.276 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2023-08-09T20:48:57.332 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2023-08-09T20:48:57.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2023-08-09T20:48:57.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2023-08-09T20:48:57.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2023-08-09T20:48:57.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2023-08-09T20:48:57.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2023-08-09T20:48:57.671 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2023-08-09T20:48:57.726 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2023-08-09T20:48:57.726 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.4 (Ootpa)"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.4"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2023-08-09T20:48:57.727 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-09T20:48:57.728 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-09T20:48:57.729 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-09T20:48:57.729 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2023-08-09T20:48:57.730 DEBUG:teuthology.parallel:result is None
2023-08-09T20:49:36.074 WARNING:teuthology.provision.fog.smithi045:timed out
2023-08-09T20:49:42.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:49:42.344 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-09T20:49:42.345 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-09T20:49:42.628 INFO:teuthology.provision.fog.smithi045:Node is ready
2023-08-09T20:49:42.628 DEBUG:teuthology.orchestra.run.smithi045:> hostname
2023-08-09T20:49:42.644 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2023-08-09T20:49:42.645 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts
2023-08-09T20:49:42.702 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2023-08-09T20:49:42.702 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-08-09T20:49:42.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts
2023-08-09T20:49:42.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts
2023-08-09T20:49:42.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname
2023-08-09T20:49:42.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-08-09T20:49:43.043 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-08-09T20:49:43.098 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.4 (Ootpa)"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.4"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-08-09T20:49:43.099 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-09T20:49:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-08-09T20:49:43.101 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-09T20:49:43.101 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-09T20:49:43.101 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-09T20:49:43.101 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-09T20:49:43.101 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2023-08-09T20:49:43.102 DEBUG:teuthology.parallel:result is None
2023-08-09T20:49:43.240 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2023-08-09T20:49:43.241 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-09T20:49:43.266 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2023-08-09T20:49:43.266 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-09T20:49:43.283 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2023-08-09T20:49:43.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-08-09T20:49:43.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:49:43.351 DEBUG:teuthology.orchestra.run.smithi032:> true
2023-08-09T20:49:43.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-08-09T20:49:43.471 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2023-08-09T20:49:43.526 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2023-08-09T20:49:43.526 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2023-08-09T20:49:43.580 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2023-08-09T20:49:43.581 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.4 (Ootpa)"
2023-08-09T20:49:43.581 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2023-08-09T20:49:43.581 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2023-08-09T20:49:43.581 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.4"
2023-08-09T20:49:43.581 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:
2023-08-09T20:49:43.582 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-09T20:49:43.583 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-09T20:49:43.583 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-09T20:49:43.583 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-09T20:49:43.583 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-08-09T20:49:43.607 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2023-08-09T20:49:43.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-08-09T20:49:43.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-09T20:49:43.675 DEBUG:teuthology.orchestra.run.smithi045:> true
2023-08-09T20:49:43.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-08-09T20:49:43.746 DEBUG:teuthology.orchestra.run.smithi045:> uname -m
2023-08-09T20:49:43.801 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2023-08-09T20:49:43.802 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.4 (Ootpa)"
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.4"
2023-08-09T20:49:43.859 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-09T20:49:43.860 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-08-09T20:49:43.861 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-09T20:49:43.861 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-09T20:49:43.861 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-09T20:49:43.861 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-09T20:49:43.861 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-08-09T20:49:43.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:49:43.976 INFO:teuthology.dispatcher.supervisor:Running job 7364390
2023-08-09T20:49:43.977 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi/7364390 --name yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi/7364390/orig.config.yaml
2023-08-09T20:49:43.980 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi/7364390
2023-08-09T20:49:43.980 INFO:teuthology.dispatcher.supervisor:Job PID: 32071
2023-08-09T20:49:43.981 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-09T20:51:44.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:53:44.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:55:44.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:57:44.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T20:59:44.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:01:44.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:03:45.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:05:45.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:07:45.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:09:45.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:11:45.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:13:45.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:15:45.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:17:46.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:19:46.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:21:46.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:23:46.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:25:46.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:27:46.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:29:47.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:31:47.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:33:47.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:35:47.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-09T21:35:47.700 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-09T21:35:47.862 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-09T21:35:47.862 INFO:teuthology.nuke:Checking targets against current locks
2023-08-09T21:35:47.903 DEBUG:teuthology.nuke:shortname: smithi032
2023-08-09T21:35:47.903 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-09T21:35:47.921 DEBUG:teuthology.nuke:shortname: smithi045
2023-08-09T21:35:47.922 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-09T21:35:47.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi/7364390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 20:44:24.022523', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnUa+93WKci31XHBueD2qDQ56VXxD3olUh+w/K5K6x4Ww0f9a697OdLKFMyPULT0dmmyfTBWQyZh4x9iQTEfEPgVCA+UQBgRWSVvU0dixVdULaQ7+lPCjpPsQsfvb9Vosy+GqUjLPk+fVi6x03oL4tXxIZ+2z1aFJX2HsMoWDHABC994E3aTLZEFtYcT0Vk0+/8grECxydgadmmhSw/CB+53+oHhKUwz744N+dp6hIUPFj+EjHioY2OeTbVQTKb4FXlE3Xr0TnkSR2M6iwWhW96bPd5hiTQq0BTRcFP5wZtRfR4tlF7gpH/MR87Yt2sZlg/nuGNPYUHRdk6cs+JnUGGyap52PnLGcFRH28Q/xZxcaR0M6onqLgaw+2mtOAoF37H2QF9IXF84EvayyAkMvLnIQeJHU3hwzdYx4c5HzYFLJCkzPlL1+Pa2oY/4VtsIabedg96ovHk8jJlkfhCqEYnZPSrckFxKIwPZ6XukZINACMx/4NpTrPO1MldbMTJSM='}
2023-08-09T21:35:47.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-09_19:50:55-fs-wip-yuri5-testing-2023-08-08-0807-quincy-distro-default-smithi/7364390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 20:44:24.023885', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD65OaiUWTWRyR6HHYg6CygSPIZoJ2Zac0pyIWMOlX6bUeBkSJ9fW1/111jWKRrJ2JSHDiaDY8SrtJp+XeJ0i60='}
2023-08-09T21:35:47.969 INFO:teuthology.orchestra.console.smithi032:Power off
2023-08-09T21:35:47.969 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-09T21:35:47.982 INFO:teuthology.orchestra.console.smithi045:Power off
2023-08-09T21:35:47.983 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-09T21:35:47.991 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2023-08-09T21:35:47.992 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T21:35:48.002 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off
2023-08-09T21:35:48.003 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-09T21:35:48.013 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-08-09T21:35:48.022 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-08-09T21:35:48.114 INFO:teuthology.orchestra.console.smithi032:Power off completed
2023-08-09T21:35:48.124 INFO:teuthology.orchestra.console.smithi045:Power off completed
2023-08-09T21:35:48.257 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2023-08-09T21:35:48.266 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com