2022-11-28T01:12:02.024 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-11-28T01:12:02.026 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260 --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} --name yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260/orig.config.yaml 2022-11-28T01:12:02.070 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-11-28T01:12:07.147 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260 branch: main description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.io first_in_suite: false job_id: '7089260' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true workunit: branch: main sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 sleep_before_teardown: 0 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 targets: smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDty59XOicOY+ZZIateWoVboG1G9z6PJp8zfevnKNkaeq8MKRi3qBReS2S3JfFsYTs2U9wtV4pjbEFkokgbCiio= smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuxujZ2eYnhKhKtK7Q563L0O/s6XG2FSnOYQDnBeX9pDo7z/Az0nPAx1SFiwalykguyg4r55HmfhU288H2zy40SaKk8Ea7cyO9BQGBddgWq8eNkdxUQ4mWkPNF1kr7MMe7IzYHXGafod2dBGPrvOY55HBea0zXbKpdSI0AsDqJKDexOZL44BNsFWA2Ktp/N23bJIUg0wcBFw6p3WmCoqdYQ3SYM+vpjspmBS6Y/l/fQTiAJ7UXLshWBpIvY0quxUOJ3GF2prfYJJwQZ8I+ubtesB71mTvw5zaB51nifjj8BWNb8/OY5eDdziqwDdbBnIPcNGyabpJVIwfF3KKAP5eZdax2K0wnpFl8rlEEWevQxUjTmrsro3pJCRd9VESy+LkYVB3IKY06JMIZNW31A1lUlSzo9CkyKbltWjs2h/qRM//z/h81H/UxXf++I2BI5zZelC70sI8c3s9mXRyNCqZiKjKXPJ26Q76Q3YSvQAtH9pZKQqnQMxbVtGZt4NvJhAk= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 4da97cf64e542f347ec47b7bdbe5eca99759f9b7 timestamp: 2022-11-23_17:40:47 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20399 2022-11-28T01:12:07.148 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa; will attempt to use it 2022-11-28T01:12:07.149 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa/tasks 2022-11-28T01:12:07.149 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-11-28T01:12:07.151 INFO:teuthology.task.internal:Checking packages... 2022-11-28T01:12:07.175 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '697b0d99d9a52df92b20c8e053dcd46c75f364a9' 2022-11-28T01:12:07.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-11-28T01:12:07.176 INFO:teuthology.packaging:ref: None 2022-11-28T01:12:07.177 INFO:teuthology.packaging:tag: None 2022-11-28T01:12:07.177 INFO:teuthology.packaging:branch: main 2022-11-28T01:12:07.177 INFO:teuthology.packaging:sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-28T01:12:07.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=main 2022-11-28T01:12:12.396 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-995-gaf6ed506-1focal 2022-11-28T01:12:12.397 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-11-28T01:12:12.404 INFO:teuthology.task.internal:no buildpackages task found 2022-11-28T01:12:12.404 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-11-28T01:12:12.413 INFO:teuthology.task.internal:Saving configuration 2022-11-28T01:12:12.436 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-11-28T01:12:12.449 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-28T01:12:16.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-28 01:07:43.042076', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPvcjWhLE2oaixHasdd68YWiA2U89Vi3WLcjWKGWiVhs'} 2022-11-28T01:12:21.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-28 01:07:43.043952', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7HXaQU+QhwInmoCkCKYD+C9V4YoP8f9taJd+mezCxY49n6iSDSkV7DrTRGrzRceCBHiajDchR9l7O1Fdd2yF4='} 2022-11-28T01:12:21.290 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-11-28T01:12:21.305 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2022-11-28T01:12:21.305 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2022-11-28T01:12:21.306 INFO:teuthology.run_tasks:Running task console_log... 2022-11-28T01:12:21.409 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4fc1f3f28>, signals=[15]) 2022-11-28T01:12:21.410 INFO:teuthology.run_tasks:Running task internal.connect... 2022-11-28T01:12:21.421 INFO:teuthology.task.internal:Opening connections... 2022-11-28T01:12:21.422 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2022-11-28T01:12:21.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-28T01:12:26.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2022-11-28T01:12:26.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-28T01:12:31.622 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-11-28T01:12:31.639 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2022-11-28T01:12:31.649 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2022-11-28T01:12:31.650 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2022-11-28T01:12:31.697 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2022-11-28T01:12:31.697 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-11-28T01:12:31.698 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2022-11-28T01:12:31.698 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2022-11-28T01:12:31.698 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-11-28T01:12:31.698 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="20.04" 2022-11-28T01:12:31.698 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2022-11-28T01:12:31.699 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-11-28T01:12:31.699 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-11-28T01:12:31.699 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-11-28T01:12:31.699 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=focal 2022-11-28T01:12:31.700 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=focal 2022-11-28T01:12:31.701 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2022-11-28T01:12:46.726 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2022-11-28T01:12:46.770 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2022-11-28T01:12:46.770 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2022-11-28T01:12:46.829 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2022-11-28T01:12:46.830 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2022-11-28T01:12:46.830 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2022-11-28T01:12:46.830 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2022-11-28T01:12:46.830 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2022-11-28T01:12:46.831 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2022-11-28T01:12:46.831 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-11-28T01:12:46.831 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2022-11-28T01:12:46.831 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-11-28T01:12:46.832 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2022-11-28T01:12:46.832 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-11-28T01:12:46.832 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-11-28T01:12:46.832 INFO:teuthology.orchestra.run.smithi181.stdout: 2022-11-28T01:12:46.832 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-11-28T01:12:46.833 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-11-28T01:12:46.833 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-11-28T01:12:46.833 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-11-28T01:12:46.834 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-11-28T01:12:51.854 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-11-28T01:12:51.868 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-11-28T01:12:51.887 INFO:teuthology.task.internal:Checking for old test directory... 2022-11-28T01:12:51.888 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2022-11-28T01:12:51.891 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2022-11-28T01:12:51.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-28T01:12:51.895 ERROR:teuthology.task.internal:Host smithi159 has stale test directory /home/ubuntu/cephtest, check lock and cleanup. 2022-11-28T01:12:51.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-28T01:12:51.911 ERROR:teuthology.task.internal:Host smithi181 has stale test directory /home/ubuntu/cephtest, check lock and cleanup. 2022-11-28T01:12:51.911 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/task/internal/__init__.py", line 300, in check_conflict raise RuntimeError('Stale jobs detected, aborting.') RuntimeError: Stale jobs detected, aborting. 2022-11-28T01:12:52.055 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8cd3ba2f77244e09b37df877ce6ca10f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/task/internal/__init__.py", line 300, in check_conflict raise RuntimeError('Stale jobs detected, aborting.') RuntimeError: Stale jobs detected, aborting. 2022-11-28T01:12:52.057 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2022-11-28T01:12:52.075 INFO:teuthology.nuke:Checking targets against current locks 2022-11-28T01:13:02.127 DEBUG:teuthology.nuke:shortname: smithi159 2022-11-28T01:13:02.128 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-28T01:13:02.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-28 01:07:43.042076', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDty59XOicOY+ZZIateWoVboG1G9z6PJp8zfevnKNkaeq8MKRi3qBReS2S3JfFsYTs2U9wtV4pjbEFkokgbCiio='} 2022-11-28T01:13:02.175 DEBUG:teuthology.nuke:shortname: smithi181 2022-11-28T01:13:02.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-28T01:13:02.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:40:47-rgw-main-distro-default-smithi/7089260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-28 01:07:43.043952', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuxujZ2eYnhKhKtK7Q563L0O/s6XG2FSnOYQDnBeX9pDo7z/Az0nPAx1SFiwalykguyg4r55HmfhU288H2zy40SaKk8Ea7cyO9BQGBddgWq8eNkdxUQ4mWkPNF1kr7MMe7IzYHXGafod2dBGPrvOY55HBea0zXbKpdSI0AsDqJKDexOZL44BNsFWA2Ktp/N23bJIUg0wcBFw6p3WmCoqdYQ3SYM+vpjspmBS6Y/l/fQTiAJ7UXLshWBpIvY0quxUOJ3GF2prfYJJwQZ8I+ubtesB71mTvw5zaB51nifjj8BWNb8/OY5eDdziqwDdbBnIPcNGyabpJVIwfF3KKAP5eZdax2K0wnpFl8rlEEWevQxUjTmrsro3pJCRd9VESy+LkYVB3IKY06JMIZNW31A1lUlSzo9CkyKbltWjs2h/qRM//z/h81H/UxXf++I2BI5zZelC70sI8c3s9mXRyNCqZiKjKXPJ26Q76Q3YSvQAtH9pZKQqnQMxbVtGZt4NvJhAk='} 2022-11-28T01:13:02.240 INFO:teuthology.orchestra.console:Power off smithi159 2022-11-28T01:13:02.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2022-11-28T01:13:02.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:02.291 INFO:teuthology.orchestra.console:Power off smithi181 2022-11-28T01:13:02.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2022-11-28T01:13:02.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:06.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:06.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:10.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:10.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:10.646 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2022-11-28T01:13:14.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:19.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:24.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:29.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:35.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:40.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-11-28T01:13:40.364 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-11-28T01:13:40.469 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} failure_reason: Stale jobs detected, aborting. owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8cd3ba2f77244e09b37df877ce6ca10f status: fail success: false 2022-11-28T01:13:40.470 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-11-28T01:13:45.559 INFO:teuthology.run:FAIL