2024-06-11T21:02:37.937 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-11T21:02:37.937 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_lflores@teuthology --verbose --archive /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953 --name lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} -- /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953/orig.config.yaml 2024-06-11T21:02:37.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T21:02:38.055 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953 branch: wip-lflores-testing-2-2024-06-10-1925 description: rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} email: null first_in_suite: false job_id: '7749953' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lflores-testing-2-2024-06-10-1925 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 osd_object_clean_region_max_num_intervals: 1000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd max backfills: 2 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lflores-testing-2-2024-06-10-1925 sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b owner: scheduled_lflores@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 7590 sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-lflores-testing-2-2024-06-10-1925 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXWAf/OCLXGqzl5y/QL65M906ce0oiVIlqPd6bOShP4fY1p0V/G5PoVplUNR0ZD9bjImP00AN88HxBfveT18PE= smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaaeE+GhhDj/BlXTA3ofNjJ10b64fTeZuPo6MyWbyeeBYXUNV/SMJfpjNFuGySFRS5Bb47EYhUAsqgTUFRKgtw= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEW0l72tZwFyzkR0dl0pmo9ZqyyT8GAIlEN7K+immEo5Gl5bieIsrMrR1qG+T5QA3r5PKQRoOouU46pQzSfJkm8= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlw3c42Fcz5T4WbuN+2kHccwuxTCtPgxcqvXqkbh79Z/CZwouT2Ciw4TXbyg3VX/UqsPQ84QtGQT6wPJYL/w6g= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVDIraZMWJkB7svt5SatsAhSPQf6eFmM9JB+jOQIdAfv/EzHDmsSjiI9ySPWzIsf5zCCQiaeoyAwxmlAsTgG8M= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzTTm6ShBIR1+xGrBk45TWbep/w7I3QzkvwbZWzGizIQ9xgyb1HDC5BO8eoPfzH5ZEZBLkMt+2Ur8djxa+GzlE= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJL/keA56RsBLS9OVqw/U3q1cGwaSyhxZ6f+V5SW0Rc9g/sjodBiiU3m1joQUGfFDgzJ1J8Pig6BZG4dFEY7LQc= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpAkOgCNYutoX/R2oW6XIoPecyxG/2Ne4YyafEGG55+3Mi9TEY7ZQAjJkE53jHA4EUut6eDa9DwGCG8tqYB80I= tasks: - install: null - ceph: null - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 4 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_crush: id: 86 max_size: 6 min_size: 3 name: jerasure86crush steps: - set_chooseleaf_tries 5 - set_choose_tries 100 - take default class hdd - choose indep 4 type host - choose indep 4 type osd - emit type: erasure erasure_code_profile: crush-failure-domain: osd k: 8 m: 6 name: jerasure86profile plugin: jerasure technique: reed_sol_van max_in_flight: 64 max_seconds: 600 objects: 1024 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400000 size: 16384 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-10_22:21:08 tube: smithi user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-11T21:02:38.055 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa; will attempt to use it 2024-06-11T21:02:38.056 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks 2024-06-11T21:02:38.056 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-11T21:02:38.057 INFO:teuthology.task.internal:Checking packages... 2024-06-11T21:02:38.076 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '37bbe1d8d788b7c9a71280e7d510c295a5853f0b' 2024-06-11T21:02:38.076 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-11T21:02:38.076 INFO:teuthology.packaging:ref: None 2024-06-11T21:02:38.076 INFO:teuthology.packaging:tag: None 2024-06-11T21:02:38.076 INFO:teuthology.packaging:branch: wip-lflores-testing-2-2024-06-10-1925 2024-06-11T21:02:38.076 INFO:teuthology.packaging:sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T21:02:38.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lflores-testing-2-2024-06-10-1925 2024-06-11T21:02:38.292 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T21:02:38.293 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-11T21:02:38.302 INFO:teuthology.task.internal:no buildpackages task found 2024-06-11T21:02:38.302 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-11T21:02:38.345 INFO:teuthology.task.internal:Saving configuration 2024-06-11T21:02:38.362 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-11T21:02:38.373 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-11T21:02:38.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.717344', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINCUtdoeVO+Fzty8eXmVbGFKMH4AjwNqV+PRjRilIS3o'} 2024-06-11T21:02:38.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.715898', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII5EwRuME+5zyDFFinmesOWxevUYI6tKnsbv604fYOKu'} 2024-06-11T21:02:38.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.714464', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKw1ee3HAoYJbOoP37pZLJg+kqb9cThbmTNXbvhZDksW'} 2024-06-11T21:02:38.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.709938', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtsRv3+ET/Xt1rcFD4lFkHhm2rHv1kcEOkpOa8A8T/w'} 2024-06-11T21:02:38.477 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.708285', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE58lWmew+EKyWB5iRWBAjRqepJrlVH8aGwzGSP/+ji1'} 2024-06-11T21:02:38.497 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.712958', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDZWm9rTxXKZBnbyHqMo7yufM9TgD4Mj8nzQGdico9qN'} 2024-06-11T21:02:38.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.705966', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPoTkVCSNI8IFI/uoFw73x54sLVU3s5ZPdvx0ZyQQTG/'} 2024-06-11T21:02:38.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 20:55:46.711451', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINmZT9yZmekLVeJ2lFHsp1mpoH1wFkB8MC4xwtvm/++R'} 2024-06-11T21:02:38.544 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-11T21:02:38.551 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-06-11T21:02:38.551 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-06-11T21:02:38.552 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-06-11T21:02:38.552 INFO:teuthology.run_tasks:Running task console_log... 2024-06-11T21:02:38.758 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3092c7bbe0>, signals=[15]) 2024-06-11T21:02:38.761 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-11T21:02:38.768 INFO:teuthology.task.internal:Opening connections... 2024-06-11T21:02:38.768 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-06-11T21:02:38.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:38.849 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-06-11T21:02:38.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:38.927 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-06-11T21:02:38.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.003 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-06-11T21:02:39.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-06-11T21:02:39.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-06-11T21:02:39.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.236 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T21:02:39.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-06-11T21:02:39.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T21:02:39.391 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-11T21:02:39.399 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-06-11T21:02:39.405 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-06-11T21:02:39.405 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-06-11T21:02:39.452 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.452 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.453 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.454 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.478 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-06-11T21:02:39.484 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-06-11T21:02:39.484 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.533 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.534 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.534 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.561 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-06-11T21:02:39.567 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-06-11T21:02:39.567 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-06-11T21:02:39.612 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.612 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.613 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.613 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.637 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-06-11T21:02:39.643 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-06-11T21:02:39.643 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.690 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.691 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.691 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.691 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.728 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-06-11T21:02:39.734 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-06-11T21:02:39.735 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.782 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.803 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-06-11T21:02:39.809 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-06-11T21:02:39.809 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-06-11T21:02:39.854 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.855 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.856 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.878 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-06-11T21:02:39.884 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-06-11T21:02:39.884 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:39.933 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:39.934 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-06-11T21:02:39.954 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-06-11T21:02:39.960 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-06-11T21:02:39.960 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-06-11T21:02:40.006 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T21:02:40.007 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T21:02:40.007 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T21:02:40.007 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T21:02:40.007 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-06-11T21:02:40.007 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-06-11T21:02:40.028 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-11T21:02:40.039 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-11T21:02:40.075 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-11T21:02:40.076 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.078 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.081 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.083 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.086 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.089 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.092 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.095 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-06-11T21:02:40.100 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-11T21:02:40.126 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-11T21:02:40.126 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.128 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.131 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.133 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.136 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.139 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.141 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.144 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-06-11T21:02:40.231 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-11T21:02:40.406 INFO:teuthology.run_tasks:Running task kernel... 2024-06-11T21:02:40.421 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-11T21:02:40.421 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-11T21:02:40.422 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/kernel.py", line 1236, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/kernel.py", line 1251, in process_role (role_remote,) = ctx.cluster.only(role).remotes.keys() ValueError: too many values to unpack (expected 1) 2024-06-11T21:02:40.585 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=46727123e9214770943abd62b9d050b1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/kernel.py", line 1236, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/kernel.py", line 1251, in process_role (role_remote,) = ctx.cluster.only(role).remotes.keys() ValueError: too many values to unpack (expected 1) 2024-06-11T21:02:40.588 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-11T21:02:40.594 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-11T21:02:40.653 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} failure_reason: too many values to unpack (expected 1) owner: scheduled_lflores@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=46727123e9214770943abd62b9d050b1 status: fail success: false 2024-06-11T21:02:40.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T21:02:40.745 INFO:teuthology.run:FAIL